Apr 14 18:39:42 user devstack@n-api.service[61672]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 14 18:39:42 user devstack@n-api.service[61672]: *** Starting uWSGI 2.0.20-debian (64bit) on [Fri Apr 14 18:39:42 2023] *** Apr 14 18:39:42 user devstack@n-api.service[61672]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 14 18:39:42 user devstack@n-api.service[61672]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 14 18:39:42 user devstack@n-api.service[61672]: nodename: user Apr 14 18:39:42 user devstack@n-api.service[61672]: machine: x86_64 Apr 14 18:39:42 user devstack@n-api.service[61672]: clock source: unix Apr 14 18:39:42 user devstack@n-api.service[61672]: pcre jit disabled Apr 14 18:39:42 user devstack@n-api.service[61672]: detected number of CPU cores: 12 Apr 14 18:39:42 user devstack@n-api.service[61672]: current working directory: / Apr 14 18:39:42 user devstack@n-api.service[61672]: detected binary path: /usr/bin/uwsgi-core Apr 14 18:39:42 user devstack@n-api.service[61672]: your processes number limit is 63638 Apr 14 18:39:42 user devstack@n-api.service[61672]: your memory page size is 4096 bytes Apr 14 18:39:42 user devstack@n-api.service[61672]: detected max file descriptor number: 2048 Apr 14 18:39:42 user devstack@n-api.service[61672]: lock engine: pthread robust mutexes Apr 14 18:39:42 user devstack@n-api.service[61672]: thunder lock: enabled Apr 14 18:39:42 user devstack@n-api.service[61672]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 14 18:39:42 user devstack@n-api.service[61672]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 14 18:39:42 user devstack@n-api.service[61672]: Python main interpreter initialized at 0x55fdb2521990 Apr 14 18:39:42 user devstack@n-api.service[61672]: python threads support enabled Apr 14 18:39:42 user devstack@n-api.service[61672]: your server socket listen backlog is limited to 100 connections Apr 14 18:39:42 user devstack@n-api.service[61672]: your mercy for graceful operations on workers is 90 seconds Apr 14 18:39:42 user devstack@n-api.service[61672]: mapped 537436 bytes (524 KB) for 3 cores Apr 14 18:39:42 user devstack@n-api.service[61672]: *** Operational MODE: preforking *** Apr 14 18:39:42 user devstack@n-api.service[61672]: *** uWSGI is running in multiple interpreter mode *** Apr 14 18:39:42 user devstack@n-api.service[61672]: spawned uWSGI master process (pid: 61672) Apr 14 18:39:42 user devstack@n-api.service[61672]: spawned uWSGI worker 1 (pid: 61673, cores: 1) Apr 14 18:39:42 user devstack@n-api.service[61672]: spawned uWSGI worker 2 (pid: 61674, cores: 1) Apr 14 18:39:42 user devstack@n-api.service[61672]: spawned uWSGI worker 3 (pid: 61675, cores: 1) Apr 14 18:39:42 user devstack@n-api.service[61672]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 14 18:39:43 user devstack@n-api.service[61675]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 18:39:43 user devstack@n-api.service[61673]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 18:39:43 user devstack@n-api.service[61674]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 18:39:46 user devstack@n-api.service[61675]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 18:39:46 user devstack@n-api.service[61675]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 18:39:46 user devstack@n-api.service[61675]: and ``live_migration_inbound_addr`` respectively. Apr 14 18:39:46 user devstack@n-api.service[61675]: ). Its value may be silently ignored in the future. Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 18:39:46 user devstack@n-api.service[61673]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 18:39:46 user devstack@n-api.service[61673]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 18:39:46 user devstack@n-api.service[61673]: and ``live_migration_inbound_addr`` respectively. Apr 14 18:39:46 user devstack@n-api.service[61673]: ). Its value may be silently ignored in the future. Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 18:39:46 user devstack@n-api.service[61674]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 18:39:46 user devstack@n-api.service[61674]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 18:39:46 user devstack@n-api.service[61674]: and ``live_migration_inbound_addr`` respectively. Apr 14 18:39:46 user devstack@n-api.service[61674]: ). Its value may be silently ignored in the future. Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61675) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61673) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61674) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 18:39:46 user devstack@n-api.service[61675]: INFO dbcounter [None req-70d8a786-a97c-449a-b5b7-846ebd42139f None None] Registered counter for database nova_api Apr 14 18:39:46 user devstack@n-api.service[61673]: INFO dbcounter [None req-de4915b3-13e2-4db6-bcbc-d28749049dbd None None] Registered counter for database nova_api Apr 14 18:39:46 user devstack@n-api.service[61674]: INFO dbcounter [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] Registered counter for database nova_api Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG oslo_db.sqlalchemy.engines [None req-70d8a786-a97c-449a-b5b7-846ebd42139f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61675) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG oslo_db.sqlalchemy.engines [None req-de4915b3-13e2-4db6-bcbc-d28749049dbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61673) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writer thread running {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writer thread running {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG oslo_db.sqlalchemy.engines [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61674) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writer thread running {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG nova.context [None req-70d8a786-a97c-449a-b5b7-846ebd42139f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2(cell1) {{(pid=61675) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG nova.context [None req-de4915b3-13e2-4db6-bcbc-d28749049dbd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2(cell1) {{(pid=61673) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-70d8a786-a97c-449a-b5b7-846ebd42139f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-70d8a786-a97c-449a-b5b7-846ebd42139f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-de4915b3-13e2-4db6-bcbc-d28749049dbd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-de4915b3-13e2-4db6-bcbc-d28749049dbd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-70d8a786-a97c-449a-b5b7-846ebd42139f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-70d8a786-a97c-449a-b5b7-846ebd42139f None None] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-de4915b3-13e2-4db6-bcbc-d28749049dbd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-70d8a786-a97c-449a-b5b7-846ebd42139f None None] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-de4915b3-13e2-4db6-bcbc-d28749049dbd None None] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-de4915b3-13e2-4db6-bcbc-d28749049dbd None None] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-70d8a786-a97c-449a-b5b7-846ebd42139f None None] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-de4915b3-13e2-4db6-bcbc-d28749049dbd None None] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG nova.context [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2(cell1) {{(pid=61674) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 18:39:46 user devstack@n-api.service[61675]: INFO dbcounter [None req-70d8a786-a97c-449a-b5b7-846ebd42139f None None] Registered counter for database nova_cell0 Apr 14 18:39:46 user devstack@n-api.service[61673]: INFO dbcounter [None req-de4915b3-13e2-4db6-bcbc-d28749049dbd None None] Registered counter for database nova_cell0 Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:39:46 user devstack@n-api.service[61675]: INFO dbcounter [None req-70d8a786-a97c-449a-b5b7-846ebd42139f None None] Registered counter for database nova_cell1 Apr 14 18:39:46 user devstack@n-api.service[61673]: INFO dbcounter [None req-de4915b3-13e2-4db6-bcbc-d28749049dbd None None] Registered counter for database nova_cell1 Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:39:46 user devstack@n-api.service[61674]: INFO dbcounter [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] Registered counter for database nova_cell0 Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG oslo_db.sqlalchemy.engines [None req-70d8a786-a97c-449a-b5b7-846ebd42139f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61675) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writer thread running {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 18:39:46 user devstack@n-api.service[61674]: INFO dbcounter [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] Registered counter for database nova_cell1 Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG oslo_db.sqlalchemy.engines [None req-70d8a786-a97c-449a-b5b7-846ebd42139f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61675) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG oslo_db.sqlalchemy.engines [None req-de4915b3-13e2-4db6-bcbc-d28749049dbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61673) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writer thread running {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG oslo_db.sqlalchemy.engines [None req-de4915b3-13e2-4db6-bcbc-d28749049dbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61673) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG oslo_db.sqlalchemy.engines [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61674) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writer thread running {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writer thread running {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 18:39:46 user devstack@n-api.service[61675]: INFO dbcounter [None req-70d8a786-a97c-449a-b5b7-846ebd42139f None None] Registered counter for database nova_cell0 Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writer thread running {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG oslo_db.sqlalchemy.engines [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61674) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 18:39:46 user devstack@n-api.service[61673]: INFO dbcounter [None req-de4915b3-13e2-4db6-bcbc-d28749049dbd None None] Registered counter for database nova_cell0 Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writer thread running {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG oslo_db.sqlalchemy.engines [None req-70d8a786-a97c-449a-b5b7-846ebd42139f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61675) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 18:39:46 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writer thread running {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG oslo_db.sqlalchemy.engines [None req-de4915b3-13e2-4db6-bcbc-d28749049dbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61673) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 18:39:46 user devstack@n-api.service[61674]: INFO dbcounter [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] Registered counter for database nova_cell0 Apr 14 18:39:46 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writer thread running {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG oslo_db.sqlalchemy.engines [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61674) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 18:39:46 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writer thread running {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 18:39:47 user devstack@n-api.service[61675]: WARNING keystonemiddleware.auth_token [None req-70d8a786-a97c-449a-b5b7-846ebd42139f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 18:39:47 user devstack@n-api.service[61673]: WARNING keystonemiddleware.auth_token [None req-de4915b3-13e2-4db6-bcbc-d28749049dbd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 18:39:47 user devstack@n-api.service[61674]: WARNING keystonemiddleware.auth_token [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 18:39:47 user devstack@n-api.service[61675]: WARNING keystonemiddleware.auth_token [None req-70d8a786-a97c-449a-b5b7-846ebd42139f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 18:39:47 user devstack@n-api.service[61673]: WARNING keystonemiddleware.auth_token [None req-de4915b3-13e2-4db6-bcbc-d28749049dbd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 18:39:47 user devstack@n-api.service[61674]: WARNING keystonemiddleware.auth_token [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 18:39:47 user devstack@n-api.service[61675]: WARNING keystonemiddleware.auth_token [None req-70d8a786-a97c-449a-b5b7-846ebd42139f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 18:39:47 user devstack@n-api.service[61673]: WARNING keystonemiddleware.auth_token [None req-de4915b3-13e2-4db6-bcbc-d28749049dbd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 18:39:47 user devstack@n-api.service[61675]: WARNING keystonemiddleware.auth_token [None req-70d8a786-a97c-449a-b5b7-846ebd42139f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 18:39:47 user devstack@n-api.service[61674]: WARNING keystonemiddleware.auth_token [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 18:39:47 user devstack@n-api.service[61673]: WARNING keystonemiddleware.auth_token [None req-de4915b3-13e2-4db6-bcbc-d28749049dbd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 18:39:47 user devstack@n-api.service[61675]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fdb2521990 pid: 61675 (default app) Apr 14 18:39:47 user devstack@n-api.service[61674]: WARNING keystonemiddleware.auth_token [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 18:39:47 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-70d8a786-a97c-449a-b5b7-846ebd42139f None None] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:39:47 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-70d8a786-a97c-449a-b5b7-846ebd42139f None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001475 Apr 14 18:39:47 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Fri Apr 14 18:39:47 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:39:47 user devstack@n-api.service[61673]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fdb2521990 pid: 61673 (default app) Apr 14 18:39:47 user devstack@n-api.service[61674]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fdb2521990 pid: 61674 (default app) Apr 14 18:41:54 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-70d8a786-a97c-449a-b5b7-846ebd42139f None None] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:41:54 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-70d8a786-a97c-449a-b5b7-846ebd42139f None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001724 Apr 14 18:41:54 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 18:41:54 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:41:54 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=3 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:41:54 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=3 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:41:54 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=3 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:41:54 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:41:55 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-b7a326d8-5d11-4c89-a97f-2c2b485d6420 admin admin] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:41:55 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-b7a326d8-5d11-4c89-a97f-2c2b485d6420 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.467757 Apr 14 18:41:55 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 14 18:41:54 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:41:57 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:41:57 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001878 Apr 14 18:41:57 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 18:41:57 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:41:57 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=3 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:41:57 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=3 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:41:57 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=3 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:41:57 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:41:57 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-e79fa3fe-0e1d-4925-b040-d6ce61d0ac02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "id": "c1", "swap": 0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 256, "vcpus": 1}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:41:57 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-e79fa3fe-0e1d-4925-b040-d6ce61d0ac02 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.349772 Apr 14 18:41:57 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 18:41:57 2023] POST /compute/v2.1/flavors => generated 405 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 18:41:57 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-243b00ba-84b5-4878-82c6-318bc4e84b55 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:41:57 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-243b00ba-84b5-4878-82c6-318bc4e84b55 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046443 Apr 14 18:41:57 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 18:41:57 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:41:59 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:41:59 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001238 Apr 14 18:41:59 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 18:41:59 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:41:59 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-9c6e8d0e-946c-4117-b14f-c33850897f07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "swap": 0}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:41:59 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-9c6e8d0e-946c-4117-b14f-c33850897f07 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.062563 Apr 14 18:41:59 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 18:41:59 2023] POST /compute/v2.1/flavors => generated 402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 18:41:59 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-833789ef-61fa-4484-a5d8-02ecce32b796 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:41:59 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-833789ef-61fa-4484-a5d8-02ecce32b796 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030443 Apr 14 18:41:59 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 18:41:59 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:42:01 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:42:01 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001514 Apr 14 18:42:01 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 18:42:01 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:42:01 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-704aab21-54be-46f1-8386-e3a134a18fb2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "disk": 10, "id": "d2", "rxtx_factor": 1.0, "ram": 1024, "name": "ds1G", "os-flavor-access:is_public": true}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:42:01 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-704aab21-54be-46f1-8386-e3a134a18fb2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.064935 Apr 14 18:42:01 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 18:42:01 2023] POST /compute/v2.1/flavors => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 18:42:01 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-507b1f7c-ae6b-44c7-889c-510dfffd6b6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:42:01 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-507b1f7c-ae6b-44c7-889c-510dfffd6b6a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025914 Apr 14 18:42:01 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 18:42:01 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:42:03 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:42:03 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001431 Apr 14 18:42:03 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 18:42:03 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:42:03 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-7f86fe91-f83a-4e77-b412-dcdeb1e1a95f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "d3", "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "ds2G", "rxtx_factor": 1.0}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:42:03 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-7f86fe91-f83a-4e77-b412-dcdeb1e1a95f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.056582 Apr 14 18:42:03 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 18:42:03 2023] POST /compute/v2.1/flavors => generated 402 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 18:42:03 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-bb7ed254-e1fb-4a1e-ad3e-207afd2d78bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:42:03 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-bb7ed254-e1fb-4a1e-ad3e-207afd2d78bb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025102 Apr 14 18:42:03 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 18:42:03 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:42:05 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:42:05 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001351 Apr 14 18:42:05 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 18:42:05 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:42:05 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-d3852e22-1f7a-43d9-b4ba-422520c40651 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 4096, "rxtx_factor": 1.0, "id": "d4", "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:42:05 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-d3852e22-1f7a-43d9-b4ba-422520c40651 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.231857 Apr 14 18:42:05 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 18:42:05 2023] POST /compute/v2.1/flavors => generated 402 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 18:42:05 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-5d952877-1c4a-4892-b506-a3c5c70fbf3a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:42:05 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-5d952877-1c4a-4892-b506-a3c5c70fbf3a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027774 Apr 14 18:42:05 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 18:42:05 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:42:07 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:42:07 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-4671a726-d616-4dd2-b7e4-ac98c6e4ba63 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001772 Apr 14 18:42:07 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 18:42:07 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:42:07 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-e1bff82b-0988-4605-ae9d-c3f5bda5f075 admin admin] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:42:07 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-e1bff82b-0988-4605-ae9d-c3f5bda5f075 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.107212 Apr 14 18:42:07 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 14 18:42:07 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:42:10 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-5d952877-1c4a-4892-b506-a3c5c70fbf3a admin admin] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:42:10 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-5d952877-1c4a-4892-b506-a3c5c70fbf3a admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001783 Apr 14 18:42:10 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 18:42:10 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:42:10 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=3 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:42:10 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=3 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:42:10 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=3 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:42:10 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:42:10 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-71da0dc4-d6a7-4592-8d51-d878c29e82b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.tiny"}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:42:10 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-71da0dc4-d6a7-4592-8d51-d878c29e82b9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.529834 Apr 14 18:42:10 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 18:42:10 2023] POST /compute/v2.1/flavors => generated 400 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 18:42:10 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-5278c83d-b127-4d05-864b-1636fb9ba7ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:42:10 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-5278c83d-b127-4d05-864b-1636fb9ba7ee admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035080 Apr 14 18:42:10 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 18:42:10 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:42:12 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-5d952877-1c4a-4892-b506-a3c5c70fbf3a admin admin] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:42:12 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-5d952877-1c4a-4892-b506-a3c5c70fbf3a admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001546 Apr 14 18:42:12 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 18:42:12 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:42:12 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-af5ea62c-0b89-43a8-b29d-f5c2c76fa0cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "id": "2", "name": "m1.small", "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:42:12 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-af5ea62c-0b89-43a8-b29d-f5c2c76fa0cc admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.064808 Apr 14 18:42:12 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 18:42:12 2023] POST /compute/v2.1/flavors => generated 403 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 18:42:12 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-d9125729-7cb9-4678-8df2-d8ba992a7b3a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:42:12 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-d9125729-7cb9-4678-8df2-d8ba992a7b3a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027066 Apr 14 18:42:12 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 18:42:12 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:42:14 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-5d952877-1c4a-4892-b506-a3c5c70fbf3a admin admin] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:42:14 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-5d952877-1c4a-4892-b506-a3c5c70fbf3a admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001550 Apr 14 18:42:14 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 18:42:14 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:42:14 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-09c6f9cb-e76b-43c9-befb-bd5754cd7ec6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "3", "swap": 0, "name": "m1.medium", "rxtx_factor": 1.0, "disk": 40, "os-flavor-access:is_public": true}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:42:14 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-09c6f9cb-e76b-43c9-befb-bd5754cd7ec6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.059694 Apr 14 18:42:14 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 18:42:14 2023] POST /compute/v2.1/flavors => generated 404 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 18:42:14 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-ffb0e343-c6dd-420e-a931-b6e325079a64 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:42:14 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-ffb0e343-c6dd-420e-a931-b6e325079a64 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023850 Apr 14 18:42:14 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 18:42:14 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:42:16 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-5d952877-1c4a-4892-b506-a3c5c70fbf3a admin admin] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:42:16 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-5d952877-1c4a-4892-b506-a3c5c70fbf3a admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.012462 Apr 14 18:42:16 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 18:42:16 2023] GET /compute/v2.1 => generated 387 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:42:16 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-7c4c4e74-fb68-483d-b4e0-abb3a1a92596 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "ram": 8192, "rxtx_factor": 1.0}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:42:16 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-7c4c4e74-fb68-483d-b4e0-abb3a1a92596 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.059494 Apr 14 18:42:16 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 18:42:16 2023] POST /compute/v2.1/flavors => generated 403 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 18:42:16 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-d638f0e7-4228-46da-b697-64e0c64e6ef1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:42:16 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-d638f0e7-4228-46da-b697-64e0c64e6ef1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024185 Apr 14 18:42:16 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 18:42:16 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:42:18 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-5d952877-1c4a-4892-b506-a3c5c70fbf3a admin admin] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:42:18 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-5d952877-1c4a-4892-b506-a3c5c70fbf3a admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001612 Apr 14 18:42:18 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 18:42:18 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:42:18 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-c2b71acd-c0ec-4036-ba3d-575598af059c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 8}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:42:18 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-c2b71acd-c0ec-4036-ba3d-575598af059c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.059714 Apr 14 18:42:18 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 18:42:18 2023] POST /compute/v2.1/flavors => generated 406 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 18:42:18 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-4d97a011-31b0-4c7a-a1aa-5b466ee096dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:42:18 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-4d97a011-31b0-4c7a-a1aa-5b466ee096dd admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025241 Apr 14 18:42:18 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 18:42:18 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:42:49 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-5d952877-1c4a-4892-b506-a3c5c70fbf3a admin admin] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:42:49 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-5d952877-1c4a-4892-b506-a3c5c70fbf3a admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001640 Apr 14 18:42:49 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 18:42:49 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:42:49 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:42:49 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-c2fba198-d056-427c-a890-3a7452bf5d92 admin admin] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:42:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c2fba198-d056-427c-a890-3a7452bf5d92 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:42:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c2fba198-d056-427c-a890-3a7452bf5d92 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:42:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c2fba198-d056-427c-a890-3a7452bf5d92 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:42:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c2fba198-d056-427c-a890-3a7452bf5d92 admin admin] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:42:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c2fba198-d056-427c-a890-3a7452bf5d92 admin admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:42:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c2fba198-d056-427c-a890-3a7452bf5d92 admin admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:42:50 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-c2fba198-d056-427c-a890-3a7452bf5d92 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.122830 Apr 14 18:42:50 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Fri Apr 14 18:42:49 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 18:43:22 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-4d97a011-31b0-4c7a-a1aa-5b466ee096dd admin admin] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:43:22 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-4d97a011-31b0-4c7a-a1aa-5b466ee096dd admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.003848 Apr 14 18:43:22 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 18:43:22 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:43:22 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:43:22 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-1e72f64f-6683-444d-84e5-cdfdccbc8aa8 admin admin] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:43:22 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-1e72f64f-6683-444d-84e5-cdfdccbc8aa8 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.077246 Apr 14 18:43:22 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Fri Apr 14 18:43:22 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:43:26 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-c2fba198-d056-427c-a890-3a7452bf5d92 admin admin] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:43:26 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-c2fba198-d056-427c-a890-3a7452bf5d92 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001764 Apr 14 18:43:26 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 18:43:26 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:43:26 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:43:26 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-642494e0-c62e-4288-ae75-4ef2b7f98441 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "42", "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 128, "name": "m1.nano", "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:43:26 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-642494e0-c62e-4288-ae75-4ef2b7f98441 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.063473 Apr 14 18:43:26 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 14 18:43:26 2023] POST /compute/v2.1/flavors => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 18:43:26 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-2613f9d0-55f5-4129-b4e0-d49bdcd6f8f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:43:26 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-2613f9d0-55f5-4129-b4e0-d49bdcd6f8f7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026384 Apr 14 18:43:26 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 14 18:43:26 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:43:30 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-c2fba198-d056-427c-a890-3a7452bf5d92 admin admin] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:43:30 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-c2fba198-d056-427c-a890-3a7452bf5d92 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002111 Apr 14 18:43:30 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 18:43:30 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:43:30 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-174531b3-e769-4528-82d3-c9a4b168a294 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "84", "ram": 192, "disk": 1, "rxtx_factor": 1.0}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:43:30 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-174531b3-e769-4528-82d3-c9a4b168a294 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070883 Apr 14 18:43:30 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 14 18:43:30 2023] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 18:43:30 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-7e0fd091-04f5-4d1b-856b-01d18847e3e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:43:30 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-7e0fd091-04f5-4d1b-856b-01d18847e3e7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027498 Apr 14 18:43:30 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 14 18:43:30 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:45:58 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:45:58 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:45:58 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=4 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:45:58 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-1f9374b4-c315-4fab-bbe9-05c9e3220ca2 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Action: 'create', calling method: .version_select at 0x7fdae2161900>, body: {"keypair": {"name": "tempest-keypair-275380641", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcnNYGBRk0T6UxqrAha7Z7Vc1FFjiy6Mjj7iMKuh2Pb5hXRv1c3o+L8zfJZoZltWQ/PaAHBztxQ47uQg4w2vJU1ykAEMJkmmLwbyLyAWrDxacAv1mprhptr2nQm4buAkw=="}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:45:59 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-1f9374b4-c315-4fab-bbe9-05c9e3220ca2 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Getting quotas for project e34cdebcd7154988a957deae140e8eab. Resources: {'key_pairs'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:45:59 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-1f9374b4-c315-4fab-bbe9-05c9e3220ca2 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Getting quotas for user 8d53edaffb8f4038abd366d7942c6bc7 and project e34cdebcd7154988a957deae140e8eab. Resources: {'key_pairs'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:45:59 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-1f9374b4-c315-4fab-bbe9-05c9e3220ca2 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.310392 Apr 14 18:45:59 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 18:45:58 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:45:59 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:45:59 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1351271638", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "networks": [{"uuid": "a4933fe8-a8cc-498f-925f-185cdae2f1f7"}]}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:45:59 user devstack@n-api.service[61675]: DEBUG nova.network.neutron [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] validate_networks() for [('a4933fe8-a8cc-498f-925f-185cdae2f1f7', None, None, None, None, None)] {{(pid=61675) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:46:01 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Flavor limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:46:01 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Image limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:46:01 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Flavor pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:46:01 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Image pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:46:01 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:46:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:02 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Getting quotas for project 424e732759884efa8fd126cd9a082c8a. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:46:02 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Getting quotas for user a644b8bb9b90494ba670da8315bfe005 and project 424e732759884efa8fd126cd9a082c8a. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:46:02 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Going to run 1 instances... {{(pid=61675) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:46:02 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:46:02 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 2.890175 Apr 14 18:46:02 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 17/47] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 18:45:59 2023] POST /compute/v2.1/servers => generated 378 bytes in 2892 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 18:46:02 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:46:02 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-4ee9fb00-e96a-4baf-8687-9c1d369b17b9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:46:02 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-4ee9fb00-e96a-4baf-8687-9c1d369b17b9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:46:02 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-4ee9fb00-e96a-4baf-8687-9c1d369b17b9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:46:02 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-4ee9fb00-e96a-4baf-8687-9c1d369b17b9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:46:02 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-4ee9fb00-e96a-4baf-8687-9c1d369b17b9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:46:02 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-4ee9fb00-e96a-4baf-8687-9c1d369b17b9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" status: 200 len: 1395 microversion: 2.87 time: 0.413754 Apr 14 18:46:02 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 16/48] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:46:02 2023] GET /compute/v2.1/servers/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 => generated 1395 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:46:03 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-359661015", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "networks": [{"uuid": "03b497b2-e5c6-4d9a-83e2-7ddf38428b4c"}]}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:04 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-79550fd5-c3dd-4740-be53-55247b03e6da tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Action: 'create', calling method: .version_select at 0x7fdae1f84670>, body: {"keypair": {"name": "tempest-keypair-1040648644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGjNz78QsEg7GY5Q/x5R0+fXhMd4+j5aNId0d7KMgDy/nQskSviXpD3wS5mHEhEb7jjb1W7n7QHncfc1ds0/3pZ7+zPW5nX4bCBjYud5GgMoBiur+7hIWtHB4iei5HABw=="}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:04 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-79550fd5-c3dd-4740-be53-55247b03e6da tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Getting quotas for project 64d84c59848f445a90eb7eab6be04253. Resources: {'key_pairs'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:46:04 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-79550fd5-c3dd-4740-be53-55247b03e6da tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Getting quotas for user 83ed7885e7774691b02c19cf08c2177f and project 64d84c59848f445a90eb7eab6be04253. Resources: {'key_pairs'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:46:04 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-79550fd5-c3dd-4740-be53-55247b03e6da tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.313884 Apr 14 18:46:04 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 18/49] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 18:46:03 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:04 user devstack@n-api.service[61674]: DEBUG nova.network.neutron [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] validate_networks() for [('03b497b2-e5c6-4d9a-83e2-7ddf38428b4c', None, None, None, None, None)] {{(pid=61674) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:46:05 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-bf08950d-0bad-4480-9f80-9ac4c30540fd tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Action: 'create', calling method: .version_select at 0x7fdae20f4b80>, body: {"keypair": {"name": "tempest-keypair-1907005832", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1SNCDT2jFA3MV2LOQf5/jQifTaElAyZBRvMGKPELy+qfHp7jNzbss7chCZ4Lyi4Hf1AsrbTQ0uCfJEZdUMCdLIpd/tPG6dSXTzuszoOSIUZSVUhcQCRAZ+G6fBKwSeEg=="}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:05 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-bf08950d-0bad-4480-9f80-9ac4c30540fd tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting quotas for project f028a79640b848228dc6e654a0eef49b. Resources: {'key_pairs'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:46:05 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-bf08950d-0bad-4480-9f80-9ac4c30540fd tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting quotas for user 55fa4abe2fdd48cb91f39bf8156a7793 and project f028a79640b848228dc6e654a0eef49b. Resources: {'key_pairs'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:46:05 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-bf08950d-0bad-4480-9f80-9ac4c30540fd tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.302000 Apr 14 18:46:05 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 17/50] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 18:46:05 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:05 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Flavor limits 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:46:05 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Image limits 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:46:05 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Flavor pref 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:46:05 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Image pref 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:46:05 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:46:05 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:05 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:05 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:05 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:05 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:05 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:05 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Getting quotas for project 04f259dc787d468596879969e33f2e62. Resources: {'ram', 'instances', 'cores'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:46:05 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Getting quotas for user 3a860138cfc74444a78dc1e456a9d67f and project 04f259dc787d468596879969e33f2e62. Resources: {'ram', 'instances', 'cores'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:46:05 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Going to run 1 instances... {{(pid=61674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:46:05 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:46:05 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.225505 Apr 14 18:46:05 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 16/51] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:46:03 2023] POST /compute/v2.1/servers => generated 378 bytes in 2227 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:46:05 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-ad1577a8-beea-442b-a7bd-f43f738be11d tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:46:05 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-ad1577a8-beea-442b-a7bd-f43f738be11d tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:46:06 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-ad1577a8-beea-442b-a7bd-f43f738be11d tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a860138cfc74444a78dc1e456a9d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f259dc787d468596879969e33f2e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:46:06 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-ad1577a8-beea-442b-a7bd-f43f738be11d tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] 10.0.0.210 "GET /compute/v2.1/servers/849b47d6-c267-420e-bb09-e43e33ad1df1" status: 200 len: 1208 microversion: 2.1 time: 0.144940 Apr 14 18:46:06 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 19/52] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:46:05 2023] GET /compute/v2.1/servers/849b47d6-c267-420e-bb09-e43e33ad1df1 => generated 1208 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:46:06 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-215795382", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ebff2aa0-97cc-48ab-8839-3dff795a5b06"}], "security_groups": [{"name": "tempest-securitygroup--1582717211"}], "key_name": "tempest-keypair-275380641", "user_data": "}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:06 user devstack@n-api.service[61673]: DEBUG nova.network.neutron [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] validate_networks() for [('ebff2aa0-97cc-48ab-8839-3dff795a5b06', None, None, None, None, None)] {{(pid=61673) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:46:08 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Flavor limits 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:46:08 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Image limits 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:46:08 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Flavor pref 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:46:08 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Image pref 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:46:08 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:46:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:08 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Getting quotas for project e34cdebcd7154988a957deae140e8eab. Resources: {'ram', 'instances', 'cores'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:46:08 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Getting quotas for user 8d53edaffb8f4038abd366d7942c6bc7 and project e34cdebcd7154988a957deae140e8eab. Resources: {'ram', 'instances', 'cores'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:46:09 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Going to run 1 instances... {{(pid=61673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:46:09 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:46:09 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.890534 Apr 14 18:46:09 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 18/53] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:46:06 2023] POST /compute/v2.1/servers => generated 400 bytes in 2892 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:46:09 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-dcb46cbb-af7a-4046-83b5-c9d788005fdb tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:46:09 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-dcb46cbb-af7a-4046-83b5-c9d788005fdb tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:46:09 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1341803639", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "networks": [{"uuid": "703a8d85-ee89-4c7b-addb-bc6424312027"}], "security_groups": [{"name": "tempest-securitygroup--2064242263"}], "key_name": "tempest-keypair-1040648644", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:09 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-dcb46cbb-af7a-4046-83b5-c9d788005fdb tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d53edaffb8f4038abd366d7942c6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34cdebcd7154988a957deae140e8eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:46:09 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-dcb46cbb-af7a-4046-83b5-c9d788005fdb tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c" status: 200 len: 1234 microversion: 2.1 time: 0.168965 Apr 14 18:46:09 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 17/54] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:46:09 2023] GET /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c => generated 1234 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:46:09 user devstack@n-api.service[61675]: DEBUG nova.network.neutron [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] validate_networks() for [('703a8d85-ee89-4c7b-addb-bc6424312027', None, None, None, None, None)] {{(pid=61675) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:46:11 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1477481393", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9"}], "security_groups": [{"name": "tempest-securitygroup--228730137"}], "key_name": "tempest-keypair-1907005832", "user_data": "}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:11 user devstack@n-api.service[61673]: DEBUG nova.network.neutron [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] validate_networks() for [('cfabb8bd-6f49-4a21-90ab-ee230e7003a9', None, None, None, None, None)] {{(pid=61673) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:46:11 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Flavor limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:46:11 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Image limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:46:11 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Flavor pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:46:11 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Image pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:46:11 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:46:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:11 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Getting quotas for project 64d84c59848f445a90eb7eab6be04253. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:46:11 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Getting quotas for user 83ed7885e7774691b02c19cf08c2177f and project 64d84c59848f445a90eb7eab6be04253. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:46:11 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Going to run 1 instances... {{(pid=61675) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:46:11 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:46:11 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.628238 Apr 14 18:46:11 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 20/55] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:46:09 2023] POST /compute/v2.1/servers => generated 404 bytes in 2630 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:46:11 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-4e9a9367-6bef-4c39-b4bc-46c8cf49c060 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:46:11 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-4e9a9367-6bef-4c39-b4bc-46c8cf49c060 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:46:11 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-4e9a9367-6bef-4c39-b4bc-46c8cf49c060 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ed7885e7774691b02c19cf08c2177f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d84c59848f445a90eb7eab6be04253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:46:11 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-4e9a9367-6bef-4c39-b4bc-46c8cf49c060 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c" status: 200 len: 1240 microversion: 2.1 time: 0.110007 Apr 14 18:46:11 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 18/56] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:46:11 2023] GET /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c => generated 1240 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:46:12 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-75144df8-7b77-4877-b2c6-e1d2358c00ae req-476551ef-03eb-4535-80e7-0be15253083c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6", "tag": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-75144df8-7b77-4877-b2c6-e1d2358c00ae req-476551ef-03eb-4535-80e7-0be15253083c service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-75144df8-7b77-4877-b2c6-e1d2358c00ae req-476551ef-03eb-4535-80e7-0be15253083c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-75144df8-7b77-4877-b2c6-e1d2358c00ae req-476551ef-03eb-4535-80e7-0be15253083c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:12 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-75144df8-7b77-4877-b2c6-e1d2358c00ae req-476551ef-03eb-4535-80e7-0be15253083c service nova] Creating event network-changed:99d9a465-1b2a-40bf-aafb-56e1a58ca1ed for instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 on user Apr 14 18:46:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-75144df8-7b77-4877-b2c6-e1d2358c00ae req-476551ef-03eb-4535-80e7-0be15253083c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61675) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 18:46:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-75144df8-7b77-4877-b2c6-e1d2358c00ae req-476551ef-03eb-4535-80e7-0be15253083c service nova] Acquired lock "compute-rpcapi-router" {{(pid=61675) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 18:46:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ef4fc679-da7c-455a-b3f6-96e7642de0a8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ef4fc679-da7c-455a-b3f6-96e7642de0a8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ef4fc679-da7c-455a-b3f6-96e7642de0a8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ef4fc679-da7c-455a-b3f6-96e7642de0a8 None None] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ef4fc679-da7c-455a-b3f6-96e7642de0a8 None None] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ef4fc679-da7c-455a-b3f6-96e7642de0a8 None None] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:12 user devstack@n-api.service[61675]: INFO nova.compute.rpcapi [None req-ef4fc679-da7c-455a-b3f6-96e7642de0a8 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 18:46:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ef4fc679-da7c-455a-b3f6-96e7642de0a8 None None] Releasing lock "compute-rpcapi-router" {{(pid=61675) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 18:46:12 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-ef4fc679-da7c-455a-b3f6-96e7642de0a8 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162382 Apr 14 18:46:12 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 21/57] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:46:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:13 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-944f87d4-7b39-4d43-bcb7-de91d3c37277 req-50775ddc-0329-4907-9c38-b0aa20cdf4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "849b47d6-c267-420e-bb09-e43e33ad1df1", "tag": "29b77a39-c2df-45c1-83ea-72ffe0a24460"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-944f87d4-7b39-4d43-bcb7-de91d3c37277 req-50775ddc-0329-4907-9c38-b0aa20cdf4c5 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-944f87d4-7b39-4d43-bcb7-de91d3c37277 req-50775ddc-0329-4907-9c38-b0aa20cdf4c5 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-944f87d4-7b39-4d43-bcb7-de91d3c37277 req-50775ddc-0329-4907-9c38-b0aa20cdf4c5 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:13 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-944f87d4-7b39-4d43-bcb7-de91d3c37277 req-50775ddc-0329-4907-9c38-b0aa20cdf4c5 service nova] Creating event network-changed:29b77a39-c2df-45c1-83ea-72ffe0a24460 for instance 849b47d6-c267-420e-bb09-e43e33ad1df1 on user Apr 14 18:46:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-944f87d4-7b39-4d43-bcb7-de91d3c37277 req-50775ddc-0329-4907-9c38-b0aa20cdf4c5 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61674) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 18:46:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-944f87d4-7b39-4d43-bcb7-de91d3c37277 req-50775ddc-0329-4907-9c38-b0aa20cdf4c5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61674) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 18:46:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-87ac44ed-68a9-4f80-aad8-bd3e498820c2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-87ac44ed-68a9-4f80-aad8-bd3e498820c2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-87ac44ed-68a9-4f80-aad8-bd3e498820c2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-87ac44ed-68a9-4f80-aad8-bd3e498820c2 None None] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-87ac44ed-68a9-4f80-aad8-bd3e498820c2 None None] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-87ac44ed-68a9-4f80-aad8-bd3e498820c2 None None] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:13 user devstack@n-api.service[61674]: INFO nova.compute.rpcapi [None req-87ac44ed-68a9-4f80-aad8-bd3e498820c2 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 18:46:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-87ac44ed-68a9-4f80-aad8-bd3e498820c2 None None] Releasing lock "compute-rpcapi-router" {{(pid=61674) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 18:46:13 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-87ac44ed-68a9-4f80-aad8-bd3e498820c2 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210424 Apr 14 18:46:13 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 19/58] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:46:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:13 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flavor limits 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:46:13 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Image limits 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:46:13 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flavor pref 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:46:13 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Image pref 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:46:13 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:46:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:14 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting quotas for project f028a79640b848228dc6e654a0eef49b. Resources: {'ram', 'instances', 'cores'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:46:14 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting quotas for user 55fa4abe2fdd48cb91f39bf8156a7793 and project f028a79640b848228dc6e654a0eef49b. Resources: {'ram', 'instances', 'cores'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:46:14 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Going to run 1 instances... {{(pid=61673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:46:14 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:46:14 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.921068 Apr 14 18:46:14 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 19/59] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:46:11 2023] POST /compute/v2.1/servers => generated 406 bytes in 2924 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:46:14 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-74f160d8-6fb3-41b0-b15c-3e66222cc64c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:46:14 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-74f160d8-6fb3-41b0-b15c-3e66222cc64c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:46:14 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-74f160d8-6fb3-41b0-b15c-3e66222cc64c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:46:14 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-74f160d8-6fb3-41b0-b15c-3e66222cc64c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 200 len: 1233 microversion: 2.1 time: 0.106238 Apr 14 18:46:14 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 22/60] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:46:14 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 1233 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:46:16 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-c939b209-2578-44ce-821f-bc3b4c93e42c req-bb684c44-cb97-45f2-87f3-d96987eaa1e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "094a4a33-569e-4137-8798-743499f1046c", "tag": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-c939b209-2578-44ce-821f-bc3b4c93e42c req-bb684c44-cb97-45f2-87f3-d96987eaa1e8 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-c939b209-2578-44ce-821f-bc3b4c93e42c req-bb684c44-cb97-45f2-87f3-d96987eaa1e8 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-c939b209-2578-44ce-821f-bc3b4c93e42c req-bb684c44-cb97-45f2-87f3-d96987eaa1e8 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:16 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-c939b209-2578-44ce-821f-bc3b4c93e42c req-bb684c44-cb97-45f2-87f3-d96987eaa1e8 service nova] Creating event network-changed:940c6edd-6fc7-4e88-92b4-38a62e88f2ab for instance 094a4a33-569e-4137-8798-743499f1046c on user Apr 14 18:46:16 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-c939b209-2578-44ce-821f-bc3b4c93e42c req-bb684c44-cb97-45f2-87f3-d96987eaa1e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045807 Apr 14 18:46:16 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 20/61] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:46:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:18 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-d72c3cbf-2ef7-4699-a499-4c2fa5d349c1 req-a35b1249-171c-4192-b8b1-4e7bf394aee4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e55c721-9fad-4478-9e74-e87d0c95bc3c", "tag": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-d72c3cbf-2ef7-4699-a499-4c2fa5d349c1 req-a35b1249-171c-4192-b8b1-4e7bf394aee4 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-d72c3cbf-2ef7-4699-a499-4c2fa5d349c1 req-a35b1249-171c-4192-b8b1-4e7bf394aee4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-d72c3cbf-2ef7-4699-a499-4c2fa5d349c1 req-a35b1249-171c-4192-b8b1-4e7bf394aee4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:18 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-d72c3cbf-2ef7-4699-a499-4c2fa5d349c1 req-a35b1249-171c-4192-b8b1-4e7bf394aee4 service nova] Creating event network-changed:66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c on user Apr 14 18:46:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-d72c3cbf-2ef7-4699-a499-4c2fa5d349c1 req-a35b1249-171c-4192-b8b1-4e7bf394aee4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61673) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 18:46:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-d72c3cbf-2ef7-4699-a499-4c2fa5d349c1 req-a35b1249-171c-4192-b8b1-4e7bf394aee4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61673) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 18:46:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ace6890c-9be4-45f5-bca0-e8a559e4b4ee None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ace6890c-9be4-45f5-bca0-e8a559e4b4ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ace6890c-9be4-45f5-bca0-e8a559e4b4ee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ace6890c-9be4-45f5-bca0-e8a559e4b4ee None None] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ace6890c-9be4-45f5-bca0-e8a559e4b4ee None None] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ace6890c-9be4-45f5-bca0-e8a559e4b4ee None None] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:18 user devstack@n-api.service[61673]: INFO nova.compute.rpcapi [None req-ace6890c-9be4-45f5-bca0-e8a559e4b4ee None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 18:46:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ace6890c-9be4-45f5-bca0-e8a559e4b4ee None None] Releasing lock "compute-rpcapi-router" {{(pid=61673) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 18:46:18 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-ace6890c-9be4-45f5-bca0-e8a559e4b4ee None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170579 Apr 14 18:46:18 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 20/62] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:46:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:20 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-4444128e-b347-4ee1-a74e-e68da3540a84 req-9519fd0d-584c-4109-aa19-15faa70e03cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "849b47d6-c267-420e-bb09-e43e33ad1df1", "name": "network-vif-plugged", "status": "completed", "tag": "29b77a39-c2df-45c1-83ea-72ffe0a24460"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:20 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-4444128e-b347-4ee1-a74e-e68da3540a84 req-9519fd0d-584c-4109-aa19-15faa70e03cf service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:20 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-4444128e-b347-4ee1-a74e-e68da3540a84 req-9519fd0d-584c-4109-aa19-15faa70e03cf service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:20 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-4444128e-b347-4ee1-a74e-e68da3540a84 req-9519fd0d-584c-4109-aa19-15faa70e03cf service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:20 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-4444128e-b347-4ee1-a74e-e68da3540a84 req-9519fd0d-584c-4109-aa19-15faa70e03cf service nova] Creating event network-vif-plugged:29b77a39-c2df-45c1-83ea-72ffe0a24460 for instance 849b47d6-c267-420e-bb09-e43e33ad1df1 on user Apr 14 18:46:20 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-4444128e-b347-4ee1-a74e-e68da3540a84 req-9519fd0d-584c-4109-aa19-15faa70e03cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052759 Apr 14 18:46:20 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 23/63] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:46:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:21 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-4163cf1f-a4c6-4088-bd44-ec83d9450a55 req-728d0eb1-2088-44ba-939e-544311bf2f88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6", "name": "network-vif-plugged", "status": "completed", "tag": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:21 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-4163cf1f-a4c6-4088-bd44-ec83d9450a55 req-728d0eb1-2088-44ba-939e-544311bf2f88 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:21 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-4163cf1f-a4c6-4088-bd44-ec83d9450a55 req-728d0eb1-2088-44ba-939e-544311bf2f88 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:21 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-4163cf1f-a4c6-4088-bd44-ec83d9450a55 req-728d0eb1-2088-44ba-939e-544311bf2f88 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:21 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-4163cf1f-a4c6-4088-bd44-ec83d9450a55 req-728d0eb1-2088-44ba-939e-544311bf2f88 service nova] Creating event network-vif-plugged:99d9a465-1b2a-40bf-aafb-56e1a58ca1ed for instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 on user Apr 14 18:46:21 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-4163cf1f-a4c6-4088-bd44-ec83d9450a55 req-728d0eb1-2088-44ba-939e-544311bf2f88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057454 Apr 14 18:46:21 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 21/64] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:46:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:22 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-988b794e-77b3-4ac3-87ce-7891ec65736e req-6ec91c12-14eb-45e2-9524-fcbb39ea6206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "849b47d6-c267-420e-bb09-e43e33ad1df1", "name": "network-vif-plugged", "status": "completed", "tag": "29b77a39-c2df-45c1-83ea-72ffe0a24460"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-988b794e-77b3-4ac3-87ce-7891ec65736e req-6ec91c12-14eb-45e2-9524-fcbb39ea6206 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-988b794e-77b3-4ac3-87ce-7891ec65736e req-6ec91c12-14eb-45e2-9524-fcbb39ea6206 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-988b794e-77b3-4ac3-87ce-7891ec65736e req-6ec91c12-14eb-45e2-9524-fcbb39ea6206 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:22 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-988b794e-77b3-4ac3-87ce-7891ec65736e req-6ec91c12-14eb-45e2-9524-fcbb39ea6206 service nova] Creating event network-vif-plugged:29b77a39-c2df-45c1-83ea-72ffe0a24460 for instance 849b47d6-c267-420e-bb09-e43e33ad1df1 on user Apr 14 18:46:22 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-988b794e-77b3-4ac3-87ce-7891ec65736e req-6ec91c12-14eb-45e2-9524-fcbb39ea6206 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042888 Apr 14 18:46:22 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 24/65] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:46:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:22 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-cfe723ec-408c-490c-a9f9-4656e867ffc6 req-4e3ecd73-cfbd-441e-9274-949b41abfa1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094a4a33-569e-4137-8798-743499f1046c", "name": "network-vif-plugged", "status": "completed", "tag": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-cfe723ec-408c-490c-a9f9-4656e867ffc6 req-4e3ecd73-cfbd-441e-9274-949b41abfa1b service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-cfe723ec-408c-490c-a9f9-4656e867ffc6 req-4e3ecd73-cfbd-441e-9274-949b41abfa1b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-cfe723ec-408c-490c-a9f9-4656e867ffc6 req-4e3ecd73-cfbd-441e-9274-949b41abfa1b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:22 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-cfe723ec-408c-490c-a9f9-4656e867ffc6 req-4e3ecd73-cfbd-441e-9274-949b41abfa1b service nova] Creating event network-vif-plugged:940c6edd-6fc7-4e88-92b4-38a62e88f2ab for instance 094a4a33-569e-4137-8798-743499f1046c on user Apr 14 18:46:22 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-cfe723ec-408c-490c-a9f9-4656e867ffc6 req-4e3ecd73-cfbd-441e-9274-949b41abfa1b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.289945 Apr 14 18:46:22 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 21/66] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:46:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:23 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=14 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:46:23 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=4 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:46:23 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-c76b9032-29f5-4392-ae10-145b1943ce2b req-5466c23b-2d75-4ca5-9c3a-10ec4567bc00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6", "name": "network-vif-plugged", "status": "completed", "tag": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-c76b9032-29f5-4392-ae10-145b1943ce2b req-5466c23b-2d75-4ca5-9c3a-10ec4567bc00 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-c76b9032-29f5-4392-ae10-145b1943ce2b req-5466c23b-2d75-4ca5-9c3a-10ec4567bc00 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-c76b9032-29f5-4392-ae10-145b1943ce2b req-5466c23b-2d75-4ca5-9c3a-10ec4567bc00 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:23 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-c76b9032-29f5-4392-ae10-145b1943ce2b req-5466c23b-2d75-4ca5-9c3a-10ec4567bc00 service nova] Creating event network-vif-plugged:99d9a465-1b2a-40bf-aafb-56e1a58ca1ed for instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 on user Apr 14 18:46:23 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-c76b9032-29f5-4392-ae10-145b1943ce2b req-5466c23b-2d75-4ca5-9c3a-10ec4567bc00 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046162 Apr 14 18:46:23 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 22/67] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:46:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:24 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-f3a7c44a-86eb-4c55-ade7-9ec8fd4ce6c4 req-7cfb45c8-2d29-42a9-96c2-6968ac4dcdb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e55c721-9fad-4478-9e74-e87d0c95bc3c", "name": "network-vif-plugged", "status": "completed", "tag": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:24 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=6 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:46:24 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=20 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:46:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-f3a7c44a-86eb-4c55-ade7-9ec8fd4ce6c4 req-7cfb45c8-2d29-42a9-96c2-6968ac4dcdb5 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-f3a7c44a-86eb-4c55-ade7-9ec8fd4ce6c4 req-7cfb45c8-2d29-42a9-96c2-6968ac4dcdb5 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-f3a7c44a-86eb-4c55-ade7-9ec8fd4ce6c4 req-7cfb45c8-2d29-42a9-96c2-6968ac4dcdb5 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:24 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-f3a7c44a-86eb-4c55-ade7-9ec8fd4ce6c4 req-7cfb45c8-2d29-42a9-96c2-6968ac4dcdb5 service nova] Creating event network-vif-plugged:66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c on user Apr 14 18:46:24 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-f3a7c44a-86eb-4c55-ade7-9ec8fd4ce6c4 req-7cfb45c8-2d29-42a9-96c2-6968ac4dcdb5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049177 Apr 14 18:46:24 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 25/68] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:46:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:24 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=18 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:46:24 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-48506f61-f8b5-4b14-b581-120a5b27d506 req-30dbd863-ffce-4fd1-8c4d-a71ba45cb775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa09363f-435d-4fa8-9f11-db0c3f4e08be", "tag": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620"}, {"server_uuid": "094a4a33-569e-4137-8798-743499f1046c", "name": "network-vif-plugged", "status": "completed", "tag": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-48506f61-f8b5-4b14-b581-120a5b27d506 req-30dbd863-ffce-4fd1-8c4d-a71ba45cb775 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-48506f61-f8b5-4b14-b581-120a5b27d506 req-30dbd863-ffce-4fd1-8c4d-a71ba45cb775 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-48506f61-f8b5-4b14-b581-120a5b27d506 req-30dbd863-ffce-4fd1-8c4d-a71ba45cb775 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:24 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-48506f61-f8b5-4b14-b581-120a5b27d506 req-30dbd863-ffce-4fd1-8c4d-a71ba45cb775 service nova] Creating event network-changed:2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance aa09363f-435d-4fa8-9f11-db0c3f4e08be on user Apr 14 18:46:24 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-48506f61-f8b5-4b14-b581-120a5b27d506 req-30dbd863-ffce-4fd1-8c4d-a71ba45cb775 service nova] Creating event network-vif-plugged:940c6edd-6fc7-4e88-92b4-38a62e88f2ab for instance 094a4a33-569e-4137-8798-743499f1046c on user Apr 14 18:46:24 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-48506f61-f8b5-4b14-b581-120a5b27d506 req-30dbd863-ffce-4fd1-8c4d-a71ba45cb775 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.083101 Apr 14 18:46:24 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 22/69] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:46:24 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 18:46:26 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-922febf8-9acb-4e32-a419-a954a62a4484 req-646f99c0-2803-4207-8eed-33e8000062f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e55c721-9fad-4478-9e74-e87d0c95bc3c", "name": "network-vif-plugged", "status": "completed", "tag": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:26 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-922febf8-9acb-4e32-a419-a954a62a4484 req-646f99c0-2803-4207-8eed-33e8000062f0 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:26 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-922febf8-9acb-4e32-a419-a954a62a4484 req-646f99c0-2803-4207-8eed-33e8000062f0 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:26 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-922febf8-9acb-4e32-a419-a954a62a4484 req-646f99c0-2803-4207-8eed-33e8000062f0 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:26 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-922febf8-9acb-4e32-a419-a954a62a4484 req-646f99c0-2803-4207-8eed-33e8000062f0 service nova] Creating event network-vif-plugged:66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c on user Apr 14 18:46:26 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-922febf8-9acb-4e32-a419-a954a62a4484 req-646f99c0-2803-4207-8eed-33e8000062f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097897 Apr 14 18:46:26 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 23/70] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:46:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:28 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-cb16c869-86b4-44b1-b474-8fb3d75c0406 req-a311bbdf-990e-4e36-aa66-72267fb16aaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa09363f-435d-4fa8-9f11-db0c3f4e08be", "name": "network-vif-plugged", "status": "completed", "tag": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:28 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-cb16c869-86b4-44b1-b474-8fb3d75c0406 req-a311bbdf-990e-4e36-aa66-72267fb16aaa service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:28 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-cb16c869-86b4-44b1-b474-8fb3d75c0406 req-a311bbdf-990e-4e36-aa66-72267fb16aaa service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:28 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-cb16c869-86b4-44b1-b474-8fb3d75c0406 req-a311bbdf-990e-4e36-aa66-72267fb16aaa service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:28 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-cb16c869-86b4-44b1-b474-8fb3d75c0406 req-a311bbdf-990e-4e36-aa66-72267fb16aaa service nova] Creating event network-vif-plugged:2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance aa09363f-435d-4fa8-9f11-db0c3f4e08be on user Apr 14 18:46:28 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-cb16c869-86b4-44b1-b474-8fb3d75c0406 req-a311bbdf-990e-4e36-aa66-72267fb16aaa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094468 Apr 14 18:46:28 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 26/71] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:46:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:29 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=6 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:46:29 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-381c7d30-c19c-4137-b8b0-b4973950a26f tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Action: 'create', calling method: .version_select at 0x7fdae16305e0>, body: {"keypair": {"name": "tempest-keypair-397111654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZS7ySskesG5sOsdo/78qFpKWUvBoA4ziFwr5nR9D/I0C4AJuScxjt9mGbYfOP2ny0gRhvcSMfmUYwkaf98qvnWLlephh7/+MOryQ3b4Xp2gDHa/s4GPuvFDf4u9butPA=="}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:29 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-381c7d30-c19c-4137-b8b0-b4973950a26f tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Getting quotas for project d22a362d9cb946a99c203366f88baafb. Resources: {'key_pairs'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:46:29 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-381c7d30-c19c-4137-b8b0-b4973950a26f tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Getting quotas for user 3f78850ecd8042dbac5f24113b9df70e and project d22a362d9cb946a99c203366f88baafb. Resources: {'key_pairs'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:46:29 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-381c7d30-c19c-4137-b8b0-b4973950a26f tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.441789 Apr 14 18:46:29 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 23/72] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 18:46:29 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:30 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-c8feefb3-ea71-4850-a38d-0c5d3a9b028d req-033e2687-d4f7-4789-bb6f-487a707dec2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa09363f-435d-4fa8-9f11-db0c3f4e08be", "name": "network-vif-plugged", "status": "completed", "tag": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:30 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=7 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:46:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-c8feefb3-ea71-4850-a38d-0c5d3a9b028d req-033e2687-d4f7-4789-bb6f-487a707dec2b service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-c8feefb3-ea71-4850-a38d-0c5d3a9b028d req-033e2687-d4f7-4789-bb6f-487a707dec2b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-c8feefb3-ea71-4850-a38d-0c5d3a9b028d req-033e2687-d4f7-4789-bb6f-487a707dec2b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:30 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=17 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:46:30 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-c8feefb3-ea71-4850-a38d-0c5d3a9b028d req-033e2687-d4f7-4789-bb6f-487a707dec2b service nova] Creating event network-vif-plugged:2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance aa09363f-435d-4fa8-9f11-db0c3f4e08be on user Apr 14 18:46:30 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-c8feefb3-ea71-4850-a38d-0c5d3a9b028d req-033e2687-d4f7-4789-bb6f-487a707dec2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057310 Apr 14 18:46:30 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 27/73] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:46:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:30 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-aa4ed122-a25e-4445-95f0-b5ed52525b97 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Action: 'create', calling method: .version_select at 0x7fdae1628670>, body: {"keypair": {"name": "tempest-keypair-1864669462", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9u1JlSuD1cJAMQzALjI/JyGRN1rOQcOW5ycbxEjDT60K921QCb9ZxtUq1EWTeVNJbS0jsJLL5PQkFgQAgckmcDooUDCEzR2biHJb/yfJQBTKMSdOIvYWSmMVbMc7s+9Q=="}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:30 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=4 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:46:30 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-aa4ed122-a25e-4445-95f0-b5ed52525b97 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Getting quotas for project 8ef3347089a742cd8533322deb96b4d0. Resources: {'key_pairs'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:46:30 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-aa4ed122-a25e-4445-95f0-b5ed52525b97 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Getting quotas for user 6224225e832d40e986e1f145295621df and project 8ef3347089a742cd8533322deb96b4d0. Resources: {'key_pairs'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:46:30 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-aa4ed122-a25e-4445-95f0-b5ed52525b97 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.472048 Apr 14 18:46:30 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 24/74] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 18:46:30 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:33 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-875405056", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "networks": [{"uuid": "054bef1d-1792-4d11-8f1a-974e696a2a77"}], "security_groups": [{"name": "tempest-securitygroup--1872599387"}], "key_name": "tempest-keypair-397111654", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:33 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=8 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:46:33 user devstack@n-api.service[61673]: DEBUG nova.network.neutron [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] validate_networks() for [('054bef1d-1792-4d11-8f1a-974e696a2a77', None, None, None, None, None)] {{(pid=61673) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:46:34 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=12 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:46:35 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-608469179", "imageRef": "aac26e93-820f-4f38-ad93-d0c6602bcb5f", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "a7f1f9e5-21ae-4bde-a369-ba247ce72d1a"}], "security_groups": [{"name": "tempest-securitygroup--2138356696"}], "key_name": "tempest-keypair-1864669462", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:35 user devstack@n-api.service[61675]: DEBUG nova.network.neutron [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] validate_networks() for [('a7f1f9e5-21ae-4bde-a369-ba247ce72d1a', None, None, None, None, None)] {{(pid=61675) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:46:35 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Flavor limits 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:46:35 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Image limits 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:46:35 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Flavor pref 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:46:35 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Image pref 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:46:35 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:46:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:35 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Getting quotas for project d22a362d9cb946a99c203366f88baafb. Resources: {'ram', 'instances', 'cores'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:46:35 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Getting quotas for user 3f78850ecd8042dbac5f24113b9df70e and project d22a362d9cb946a99c203366f88baafb. Resources: {'ram', 'instances', 'cores'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:46:35 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Going to run 1 instances... {{(pid=61673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:46:35 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:46:35 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.251054 Apr 14 18:46:35 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 24/75] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:46:33 2023] POST /compute/v2.1/servers => generated 404 bytes in 2253 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:46:35 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-02bfe321-d5e6-49e7-a970-5ddf7d044fbe tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:46:35 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-02bfe321-d5e6-49e7-a970-5ddf7d044fbe tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:46:36 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-02bfe321-d5e6-49e7-a970-5ddf7d044fbe tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f78850ecd8042dbac5f24113b9df70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22a362d9cb946a99c203366f88baafb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:46:36 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-02bfe321-d5e6-49e7-a970-5ddf7d044fbe tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/817f112c-d806-4800-9e4a-a3892c54bee1" status: 200 len: 1234 microversion: 2.1 time: 0.265104 Apr 14 18:46:36 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 25/76] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:46:35 2023] GET /compute/v2.1/servers/817f112c-d806-4800-9e4a-a3892c54bee1 => generated 1234 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:46:37 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Flavor limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:46:37 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Image limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:46:37 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Flavor pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:46:37 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Image pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:46:37 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:46:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:37 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Getting quotas for project 8ef3347089a742cd8533322deb96b4d0. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:46:37 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Getting quotas for user 6224225e832d40e986e1f145295621df and project 8ef3347089a742cd8533322deb96b4d0. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:46:37 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Going to run 1 instances... {{(pid=61675) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:46:37 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aac26e93-820f-4f38-ad93-d0c6602bcb5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:46:37 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.518195 Apr 14 18:46:37 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 28/77] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:46:35 2023] POST /compute/v2.1/servers => generated 404 bytes in 2521 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:46:37 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-f60f620f-c58a-484b-908a-a80ba90f17d3 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:46:37 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-f60f620f-c58a-484b-908a-a80ba90f17d3 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:46:37 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-f60f620f-c58a-484b-908a-a80ba90f17d3 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6224225e832d40e986e1f145295621df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef3347089a742cd8533322deb96b4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:46:37 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-f60f620f-c58a-484b-908a-a80ba90f17d3 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] 10.0.0.210 "GET /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8" status: 200 len: 1239 microversion: 2.1 time: 0.137090 Apr 14 18:46:37 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 25/78] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:46:37 2023] GET /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8 => generated 1239 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:46:40 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-19e31557-ae94-460e-a4b5-02431f74f515 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Action: 'create', calling method: .version_select at 0x7fdae1629630>, body: {"keypair": {"name": "tempest-keypair-1208398939", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrYUmyFto3lIJuJXMBF4CtTfKVUh4V940geNTK4f4QpKuvkvp83JV/2A/URZIxQB6Rti00M04f5rrnUAVtSObiD6MPSlbY3ycoBt9DEYh9gUdRaEpFW19N4OEj4Ecmh4Q=="}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:40 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=14 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:46:40 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-19e31557-ae94-460e-a4b5-02431f74f515 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Getting quotas for project efae74f239e14c29b3af28c7fceee94d. Resources: {'key_pairs'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:46:40 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-19e31557-ae94-460e-a4b5-02431f74f515 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Getting quotas for user b083d961ab7546a7bb743d034c5e0815 and project efae74f239e14c29b3af28c7fceee94d. Resources: {'key_pairs'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:46:40 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-19e31557-ae94-460e-a4b5-02431f74f515 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.49 time: 0.085056 Apr 14 18:46:40 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 26/79] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 18:46:40 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 87 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 18:46:41 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-3510215f-da85-4e76-bfe8-6ab44ff0f82f req-aea0cfe9-d29f-4379-ae69-f92d8311ef1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "817f112c-d806-4800-9e4a-a3892c54bee1", "tag": "4a744ab3-b516-4349-adfd-98d2ce4332d2"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-3510215f-da85-4e76-bfe8-6ab44ff0f82f req-aea0cfe9-d29f-4379-ae69-f92d8311ef1f service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-3510215f-da85-4e76-bfe8-6ab44ff0f82f req-aea0cfe9-d29f-4379-ae69-f92d8311ef1f service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-3510215f-da85-4e76-bfe8-6ab44ff0f82f req-aea0cfe9-d29f-4379-ae69-f92d8311ef1f service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:41 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-4520e73a-c445-4c86-813a-5f3f786454f8 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Action: 'create', calling method: .version_select at 0x7fdae1f743a0>, body: {"keypair": {"name": "tempest-keypair-722895534", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOcIcfC08JbrvyMMglu/V2efEjoIrZskk6UZHHoxW7DVh/jlMeXwPkJZmJMxozdeySiwAj/pr6qdWwdHomjdRl/ESLuT0VCmFkV9cmikCZjGBOAStqcadvbYVvOOci8wQ=="}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:41 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-4520e73a-c445-4c86-813a-5f3f786454f8 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Getting quotas for project 418926b6689d48e3b7288ce32834dc93. Resources: {'key_pairs'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:46:41 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-3510215f-da85-4e76-bfe8-6ab44ff0f82f req-aea0cfe9-d29f-4379-ae69-f92d8311ef1f service nova] Creating event network-changed:4a744ab3-b516-4349-adfd-98d2ce4332d2 for instance 817f112c-d806-4800-9e4a-a3892c54bee1 on user Apr 14 18:46:41 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-3510215f-da85-4e76-bfe8-6ab44ff0f82f req-aea0cfe9-d29f-4379-ae69-f92d8311ef1f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148487 Apr 14 18:46:41 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-4520e73a-c445-4c86-813a-5f3f786454f8 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Getting quotas for user 3acb40ab30d44d5ebd26c3956b6d7e54 and project 418926b6689d48e3b7288ce32834dc93. Resources: {'key_pairs'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:46:41 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 29/80] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:46:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:41 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-4520e73a-c445-4c86-813a-5f3f786454f8 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.102221 Apr 14 18:46:41 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 26/81] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 18:46:41 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:43 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-444984251", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "1b859fd2-98b3-4a26-97a9-7208e978bae8"}], "security_groups": [{"name": "tempest-securitygroup--1831315579"}], "key_name": "tempest-keypair-1208398939", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:44 user devstack@n-api.service[61674]: DEBUG nova.network.neutron [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] validate_networks() for [('1b859fd2-98b3-4a26-97a9-7208e978bae8', None, None, None, None, None)] {{(pid=61674) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:46:44 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Flavor limits 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:46:44 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Image limits 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:46:44 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Flavor pref 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:46:44 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Image pref 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:46:44 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:46:44 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:44 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:44 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:44 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:44 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:44 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:44 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Getting quotas for project efae74f239e14c29b3af28c7fceee94d. Resources: {'ram', 'instances', 'cores'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:46:44 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Getting quotas for user b083d961ab7546a7bb743d034c5e0815 and project efae74f239e14c29b3af28c7fceee94d. Resources: {'ram', 'instances', 'cores'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:46:44 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Going to run 1 instances... {{(pid=61674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:46:44 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:46:45 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 1.105720 Apr 14 18:46:45 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 27/82] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 18:46:43 2023] POST /compute/v2.1/servers => generated 404 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 18:46:45 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-1de070a8-3c40-4a0a-b277-c0f0ba9dff23 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:46:45 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-1de070a8-3c40-4a0a-b277-c0f0ba9dff23 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:46:45 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-1de070a8-3c40-4a0a-b277-c0f0ba9dff23 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b083d961ab7546a7bb743d034c5e0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efae74f239e14c29b3af28c7fceee94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:46:45 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-1de070a8-3c40-4a0a-b277-c0f0ba9dff23 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b083d961ab7546a7bb743d034c5e0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efae74f239e14c29b3af28c7fceee94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:46:45 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-1de070a8-3c40-4a0a-b277-c0f0ba9dff23 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b083d961ab7546a7bb743d034c5e0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efae74f239e14c29b3af28c7fceee94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:46:45 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-1de070a8-3c40-4a0a-b277-c0f0ba9dff23 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" status: 200 len: 1320 microversion: 2.49 time: 0.136567 Apr 14 18:46:45 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 30/83] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:46:45 2023] GET /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 => generated 1320 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:46:45 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:46:45 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:46:45 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-590ade44-3ce9-4d8b-867d-2f43f3626340 req-7b63181c-20e1-41ca-bc94-482f9ff0315b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "817f112c-d806-4800-9e4a-a3892c54bee1", "name": "network-vif-plugged", "status": "completed", "tag": "4a744ab3-b516-4349-adfd-98d2ce4332d2"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:45 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-590ade44-3ce9-4d8b-867d-2f43f3626340 req-7b63181c-20e1-41ca-bc94-482f9ff0315b service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:45 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-590ade44-3ce9-4d8b-867d-2f43f3626340 req-7b63181c-20e1-41ca-bc94-482f9ff0315b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:45 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-590ade44-3ce9-4d8b-867d-2f43f3626340 req-7b63181c-20e1-41ca-bc94-482f9ff0315b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:45 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-590ade44-3ce9-4d8b-867d-2f43f3626340 req-7b63181c-20e1-41ca-bc94-482f9ff0315b service nova] Creating event network-vif-plugged:4a744ab3-b516-4349-adfd-98d2ce4332d2 for instance 817f112c-d806-4800-9e4a-a3892c54bee1 on user Apr 14 18:46:45 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-590ade44-3ce9-4d8b-867d-2f43f3626340 req-7b63181c-20e1-41ca-bc94-482f9ff0315b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061970 Apr 14 18:46:45 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 27/84] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:46:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:47 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-610939182", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "networks": [{"uuid": "85ad9a3e-94ad-4864-a75e-2ace633bd132"}], "security_groups": [{"name": "tempest-securitygroup--186484689"}], "key_name": "tempest-keypair-722895534", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:47 user devstack@n-api.service[61674]: DEBUG nova.network.neutron [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] validate_networks() for [('85ad9a3e-94ad-4864-a75e-2ace633bd132', None, None, None, None, None)] {{(pid=61674) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:46:47 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:46:47 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-35cd842c-e37b-44b6-8ead-9b1e3cc47237 req-beaecb5b-ffcd-467c-ba87-083c7ac49c69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "499df49b-4a00-447b-bd2f-b027fb44f3b8", "tag": "51aafe60-87de-4ca9-8168-cbac2aeb557e"}, {"server_uuid": "817f112c-d806-4800-9e4a-a3892c54bee1", "name": "network-vif-plugged", "status": "completed", "tag": "4a744ab3-b516-4349-adfd-98d2ce4332d2"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:47 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-35cd842c-e37b-44b6-8ead-9b1e3cc47237 req-beaecb5b-ffcd-467c-ba87-083c7ac49c69 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:47 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-35cd842c-e37b-44b6-8ead-9b1e3cc47237 req-beaecb5b-ffcd-467c-ba87-083c7ac49c69 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:47 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-35cd842c-e37b-44b6-8ead-9b1e3cc47237 req-beaecb5b-ffcd-467c-ba87-083c7ac49c69 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:47 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-35cd842c-e37b-44b6-8ead-9b1e3cc47237 req-beaecb5b-ffcd-467c-ba87-083c7ac49c69 service nova] Creating event network-changed:51aafe60-87de-4ca9-8168-cbac2aeb557e for instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 on user Apr 14 18:46:47 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-35cd842c-e37b-44b6-8ead-9b1e3cc47237 req-beaecb5b-ffcd-467c-ba87-083c7ac49c69 service nova] Creating event network-vif-plugged:4a744ab3-b516-4349-adfd-98d2ce4332d2 for instance 817f112c-d806-4800-9e4a-a3892c54bee1 on user Apr 14 18:46:47 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-35cd842c-e37b-44b6-8ead-9b1e3cc47237 req-beaecb5b-ffcd-467c-ba87-083c7ac49c69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.076090 Apr 14 18:46:47 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 31/85] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:46:47 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:48 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Flavor limits 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:46:48 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Image limits 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:46:48 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Flavor pref 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:46:48 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Image pref 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:46:48 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:46:48 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:48 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:48 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:48 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:48 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:48 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:48 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Getting quotas for project 418926b6689d48e3b7288ce32834dc93. Resources: {'ram', 'instances', 'cores'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:46:48 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Getting quotas for user 3acb40ab30d44d5ebd26c3956b6d7e54 and project 418926b6689d48e3b7288ce32834dc93. Resources: {'ram', 'instances', 'cores'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:46:48 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Going to run 1 instances... {{(pid=61674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:46:48 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:46:48 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.344066 Apr 14 18:46:48 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 28/86] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:46:47 2023] POST /compute/v2.1/servers => generated 403 bytes in 1346 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:46:48 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-7bf3a3ad-39b1-44a6-addc-598bfe7aec8b tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:46:48 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-7bf3a3ad-39b1-44a6-addc-598bfe7aec8b tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:46:48 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-7bf3a3ad-39b1-44a6-addc-598bfe7aec8b tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb40ab30d44d5ebd26c3956b6d7e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418926b6689d48e3b7288ce32834dc93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:46:48 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-7bf3a3ad-39b1-44a6-addc-598bfe7aec8b tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6" status: 200 len: 1224 microversion: 2.1 time: 0.119876 Apr 14 18:46:48 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 28/87] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:46:48 2023] GET /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6 => generated 1224 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:46:49 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-93b4db1a-6449-464d-83a0-7ef325c5adfb req-542706ca-e4e8-494e-be7a-c78f61f3d866 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99", "tag": "a23ae571-1be9-4877-b629-567eb9c62b9d"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-93b4db1a-6449-464d-83a0-7ef325c5adfb req-542706ca-e4e8-494e-be7a-c78f61f3d866 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-93b4db1a-6449-464d-83a0-7ef325c5adfb req-542706ca-e4e8-494e-be7a-c78f61f3d866 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-93b4db1a-6449-464d-83a0-7ef325c5adfb req-542706ca-e4e8-494e-be7a-c78f61f3d866 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:49 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-93b4db1a-6449-464d-83a0-7ef325c5adfb req-542706ca-e4e8-494e-be7a-c78f61f3d866 service nova] Creating event network-changed:a23ae571-1be9-4877-b629-567eb9c62b9d for instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 on user Apr 14 18:46:49 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-93b4db1a-6449-464d-83a0-7ef325c5adfb req-542706ca-e4e8-494e-be7a-c78f61f3d866 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041533 Apr 14 18:46:49 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 32/88] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:46:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:50 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-d1189278-3508-4086-a3fb-c1f2e13af368 req-c83015ac-de1b-4bd8-a9c0-967868f966e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "499df49b-4a00-447b-bd2f-b027fb44f3b8", "name": "network-vif-plugged", "status": "completed", "tag": "51aafe60-87de-4ca9-8168-cbac2aeb557e"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-d1189278-3508-4086-a3fb-c1f2e13af368 req-c83015ac-de1b-4bd8-a9c0-967868f966e8 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-d1189278-3508-4086-a3fb-c1f2e13af368 req-c83015ac-de1b-4bd8-a9c0-967868f966e8 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-d1189278-3508-4086-a3fb-c1f2e13af368 req-c83015ac-de1b-4bd8-a9c0-967868f966e8 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:50 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-d1189278-3508-4086-a3fb-c1f2e13af368 req-c83015ac-de1b-4bd8-a9c0-967868f966e8 service nova] Creating event network-vif-plugged:51aafe60-87de-4ca9-8168-cbac2aeb557e for instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 on user Apr 14 18:46:50 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-d1189278-3508-4086-a3fb-c1f2e13af368 req-c83015ac-de1b-4bd8-a9c0-967868f966e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047663 Apr 14 18:46:50 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 29/89] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:46:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:51 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-41564efe-29d5-4b84-96d2-f613db56b9e0 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Action: 'create', calling method: .version_select at 0x7fdae1631bd0>, body: {"keypair": {"name": "tempest-keypair-1451762100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3HZ+gtzuGA+x+Hka7NtDZs3M6+ycv0+xqOtXb4rCkWleVSlwqjdX1AHt6sHXDoCu/XLut6jIDVWjvyGwUB4Hot8ZhyDEV+59XCOtvrNaMMMSCBKqzLdlwu7m8/0sBWkw=="}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:51 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-41564efe-29d5-4b84-96d2-f613db56b9e0 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Getting quotas for project 72ec916e861d448a853251f522699446. Resources: {'key_pairs'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:46:51 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-41564efe-29d5-4b84-96d2-f613db56b9e0 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Getting quotas for user d4dc36f0048042929d1230f99e2be306 and project 72ec916e861d448a853251f522699446. Resources: {'key_pairs'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:46:51 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-41564efe-29d5-4b84-96d2-f613db56b9e0 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.068598 Apr 14 18:46:51 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 29/90] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 18:46:51 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Apr 14 18:46:52 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-5d895f6f-3f18-4094-a0a5-704a42f3bbb1 req-f16e5107-abf5-424e-92cf-6ed8d7ac4ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "499df49b-4a00-447b-bd2f-b027fb44f3b8", "name": "network-vif-plugged", "status": "completed", "tag": "51aafe60-87de-4ca9-8168-cbac2aeb557e"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:52 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-5d895f6f-3f18-4094-a0a5-704a42f3bbb1 req-f16e5107-abf5-424e-92cf-6ed8d7ac4ea8 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:52 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-5d895f6f-3f18-4094-a0a5-704a42f3bbb1 req-f16e5107-abf5-424e-92cf-6ed8d7ac4ea8 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:52 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-5d895f6f-3f18-4094-a0a5-704a42f3bbb1 req-f16e5107-abf5-424e-92cf-6ed8d7ac4ea8 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:52 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-5d895f6f-3f18-4094-a0a5-704a42f3bbb1 req-f16e5107-abf5-424e-92cf-6ed8d7ac4ea8 service nova] Creating event network-vif-plugged:51aafe60-87de-4ca9-8168-cbac2aeb557e for instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 on user Apr 14 18:46:52 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-5d895f6f-3f18-4094-a0a5-704a42f3bbb1 req-f16e5107-abf5-424e-92cf-6ed8d7ac4ea8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040363 Apr 14 18:46:52 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 33/91] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:46:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:52 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-8665cc6c-8b88-4b82-b122-ef08a53f4a16 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:46:52 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-8665cc6c-8b88-4b82-b122-ef08a53f4a16 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:46:52 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8665cc6c-8b88-4b82-b122-ef08a53f4a16 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:52 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8665cc6c-8b88-4b82-b122-ef08a53f4a16 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:52 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8665cc6c-8b88-4b82-b122-ef08a53f4a16 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:52 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8665cc6c-8b88-4b82-b122-ef08a53f4a16 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:52 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8665cc6c-8b88-4b82-b122-ef08a53f4a16 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:52 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8665cc6c-8b88-4b82-b122-ef08a53f4a16 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:53 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-8665cc6c-8b88-4b82-b122-ef08a53f4a16 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:46:53 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-8665cc6c-8b88-4b82-b122-ef08a53f4a16 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:46:53 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-8665cc6c-8b88-4b82-b122-ef08a53f4a16 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:46:53 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-8665cc6c-8b88-4b82-b122-ef08a53f4a16 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" status: 200 len: 1690 microversion: 2.87 time: 0.456773 Apr 14 18:46:53 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 30/92] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:46:52 2023] GET /compute/v2.1/servers/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 => generated 1690 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:46:54 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e03adca9-8b0c-416c-943e-7dce251547c6", "tag": "fd4a0af3-b371-4b85-8a45-3b68d9884358"}, {"server_uuid": "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99", "name": "network-vif-plugged", "status": "completed", "tag": "a23ae571-1be9-4877-b629-567eb9c62b9d"}, {"server_uuid": "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99", "name": "network-vif-plugged", "status": "completed", "tag": "a23ae571-1be9-4877-b629-567eb9c62b9d"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:54 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:54 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:54 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:54 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] Creating event network-changed:fd4a0af3-b371-4b85-8a45-3b68d9884358 for instance e03adca9-8b0c-416c-943e-7dce251547c6 on user Apr 14 18:46:54 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] Creating event network-vif-plugged:a23ae571-1be9-4877-b629-567eb9c62b9d for instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 on user Apr 14 18:46:54 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] Creating event network-vif-plugged:a23ae571-1be9-4877-b629-567eb9c62b9d for instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 on user Apr 14 18:46:54 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.048344 Apr 14 18:46:54 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 30/93] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:46:54 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:54 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2139810986", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "7745e31f-d91c-446a-a70a-50c6c684b42b"}, {"port": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "tag": "port-1"}, {"port": "d30907fa-2785-4ffe-8552-7221fbff7200", "tag": "port-2"}, {"uuid": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "tag": "net-1"}, {"uuid": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf"}, {"uuid": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "0ec2c8d4-acb4-4707-937f-3834d2130019", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "382a8e93-fd2e-41aa-b8a2-b2458e16c786", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "330b8b4e-5b68-43de-b1fb-f661060cc9ca", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1084382249"}], "key_name": "tempest-keypair-1451762100", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:54 user devstack@n-api.service[61675]: DEBUG nova.network.neutron [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] validate_networks() for [('7745e31f-d91c-446a-a70a-50c6c684b42b', None, None, None, None, None), (None, None, '83687b87-4245-4c8f-9a7e-d18dd00942d3', None, None, None), (None, None, 'd30907fa-2785-4ffe-8552-7221fbff7200', None, None, None), ('2a955ec6-6f4e-47c7-beb3-46232e7a5baf', None, None, None, None, None), ('2a955ec6-6f4e-47c7-beb3-46232e7a5baf', None, None, None, None, None), ('1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d', '10.2.2.100', None, None, None, None), ('1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d', '10.2.2.200', None, None, None, None)] {{(pid=61675) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:46:55 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=8 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:46:56 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-bfb2f9a6-eb40-43ab-ab13-f1f5fac83c87 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:46:56 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-bfb2f9a6-eb40-43ab-ab13-f1f5fac83c87 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:46:56 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bfb2f9a6-eb40-43ab-ab13-f1f5fac83c87 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:56 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bfb2f9a6-eb40-43ab-ab13-f1f5fac83c87 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:56 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bfb2f9a6-eb40-43ab-ab13-f1f5fac83c87 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:56 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bfb2f9a6-eb40-43ab-ab13-f1f5fac83c87 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:56 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bfb2f9a6-eb40-43ab-ab13-f1f5fac83c87 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:56 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bfb2f9a6-eb40-43ab-ab13-f1f5fac83c87 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:56 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-878073ce-67da-42f8-b84b-d06b282e4ad0 req-56177a7a-8733-4e22-8423-b916a020e5ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e03adca9-8b0c-416c-943e-7dce251547c6", "name": "network-vif-plugged", "status": "completed", "tag": "fd4a0af3-b371-4b85-8a45-3b68d9884358"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:56 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-878073ce-67da-42f8-b84b-d06b282e4ad0 req-56177a7a-8733-4e22-8423-b916a020e5ad service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:56 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-878073ce-67da-42f8-b84b-d06b282e4ad0 req-56177a7a-8733-4e22-8423-b916a020e5ad service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:56 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-878073ce-67da-42f8-b84b-d06b282e4ad0 req-56177a7a-8733-4e22-8423-b916a020e5ad service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:56 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-878073ce-67da-42f8-b84b-d06b282e4ad0 req-56177a7a-8733-4e22-8423-b916a020e5ad service nova] Creating event network-vif-plugged:fd4a0af3-b371-4b85-8a45-3b68d9884358 for instance e03adca9-8b0c-416c-943e-7dce251547c6 on user Apr 14 18:46:56 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-878073ce-67da-42f8-b84b-d06b282e4ad0 req-56177a7a-8733-4e22-8423-b916a020e5ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046972 Apr 14 18:46:56 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 31/94] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:46:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:57 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-bfb2f9a6-eb40-43ab-ab13-f1f5fac83c87 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a860138cfc74444a78dc1e456a9d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f259dc787d468596879969e33f2e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:46:57 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-bfb2f9a6-eb40-43ab-ab13-f1f5fac83c87 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] 10.0.0.210 "GET /compute/v2.1/servers/849b47d6-c267-420e-bb09-e43e33ad1df1" status: 200 len: 1489 microversion: 2.1 time: 1.369087 Apr 14 18:46:57 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 31/95] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:46:56 2023] GET /compute/v2.1/servers/849b47d6-c267-420e-bb09-e43e33ad1df1 => generated 1489 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:46:58 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-a52455a3-0a74-4355-ad84-1d03e7c5f870 req-286d41d5-70a9-4c9f-8e01-6b3285883b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e03adca9-8b0c-416c-943e-7dce251547c6", "name": "network-vif-plugged", "status": "completed", "tag": "fd4a0af3-b371-4b85-8a45-3b68d9884358"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:46:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-a52455a3-0a74-4355-ad84-1d03e7c5f870 req-286d41d5-70a9-4c9f-8e01-6b3285883b42 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-a52455a3-0a74-4355-ad84-1d03e7c5f870 req-286d41d5-70a9-4c9f-8e01-6b3285883b42 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-a52455a3-0a74-4355-ad84-1d03e7c5f870 req-286d41d5-70a9-4c9f-8e01-6b3285883b42 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:58 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-a52455a3-0a74-4355-ad84-1d03e7c5f870 req-286d41d5-70a9-4c9f-8e01-6b3285883b42 service nova] Creating event network-vif-plugged:fd4a0af3-b371-4b85-8a45-3b68d9884358 for instance e03adca9-8b0c-416c-943e-7dce251547c6 on user Apr 14 18:46:58 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-a52455a3-0a74-4355-ad84-1d03e7c5f870 req-286d41d5-70a9-4c9f-8e01-6b3285883b42 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067191 Apr 14 18:46:58 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 32/96] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:46:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:46:59 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Flavor limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:46:59 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Image limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:46:59 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Flavor pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:46:59 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Image pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:46:59 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:46:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:59 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Getting quotas for project 72ec916e861d448a853251f522699446. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:46:59 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Getting quotas for user d4dc36f0048042929d1230f99e2be306 and project 72ec916e861d448a853251f522699446. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:46:59 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-00cff583-7c62-4224-b0af-e0a3402ffc2a tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:46:59 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-00cff583-7c62-4224-b0af-e0a3402ffc2a tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:46:59 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=4 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:46:59 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=22 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:46:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-00cff583-7c62-4224-b0af-e0a3402ffc2a tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-00cff583-7c62-4224-b0af-e0a3402ffc2a tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-00cff583-7c62-4224-b0af-e0a3402ffc2a tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-00cff583-7c62-4224-b0af-e0a3402ffc2a tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:46:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-00cff583-7c62-4224-b0af-e0a3402ffc2a tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:46:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-00cff583-7c62-4224-b0af-e0a3402ffc2a tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:46:59 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Going to run 1 instances... {{(pid=61675) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:46:59 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='0ec2c8d4-acb4-4707-937f-3834d2130019',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='382a8e93-fd2e-41aa-b8a2-b2458e16c786',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='330b8b4e-5b68-43de-b1fb-f661060cc9ca',volume_size=None,volume_type=None)] {{(pid=61675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:46:59 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-00cff583-7c62-4224-b0af-e0a3402ffc2a tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d53edaffb8f4038abd366d7942c6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34cdebcd7154988a957deae140e8eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:46:59 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-00cff583-7c62-4224-b0af-e0a3402ffc2a tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c" status: 200 len: 1544 microversion: 2.1 time: 0.355187 Apr 14 18:46:59 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 32/97] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:46:59 2023] GET /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c => generated 1544 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:47:00 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 5.448829 Apr 14 18:47:00 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 34/98] 10.0.0.210 () {66 vars in 1266 bytes} [Fri Apr 14 18:46:54 2023] POST /compute/v2.1/servers => generated 404 bytes in 5452 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 18:47:00 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-8afffe23-c6d3-4681-adc7-13f62e9eb20b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:47:00 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-8afffe23-c6d3-4681-adc7-13f62e9eb20b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:47:00 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-8afffe23-c6d3-4681-adc7-13f62e9eb20b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4dc36f0048042929d1230f99e2be306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ec916e861d448a853251f522699446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:47:00 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=23 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:47:00 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-8afffe23-c6d3-4681-adc7-13f62e9eb20b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4dc36f0048042929d1230f99e2be306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ec916e861d448a853251f522699446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:47:00 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-8afffe23-c6d3-4681-adc7-13f62e9eb20b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4dc36f0048042929d1230f99e2be306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ec916e861d448a853251f522699446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:47:00 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-8afffe23-c6d3-4681-adc7-13f62e9eb20b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3378ec4-364a-4656-ac99-500be9d40749" status: 200 len: 1280 microversion: 2.32 time: 0.114529 Apr 14 18:47:00 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 33/99] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:47:00 2023] GET /compute/v2.1/servers/a3378ec4-364a-4656-ac99-500be9d40749 => generated 1280 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:47:01 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-5b4cf275-536b-4bba-90f5-50867a58ed3f tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:47:01 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-5b4cf275-536b-4bba-90f5-50867a58ed3f tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:47:01 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=8 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:47:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5b4cf275-536b-4bba-90f5-50867a58ed3f tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5b4cf275-536b-4bba-90f5-50867a58ed3f tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5b4cf275-536b-4bba-90f5-50867a58ed3f tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5b4cf275-536b-4bba-90f5-50867a58ed3f tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5b4cf275-536b-4bba-90f5-50867a58ed3f tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5b4cf275-536b-4bba-90f5-50867a58ed3f tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:02 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-5b4cf275-536b-4bba-90f5-50867a58ed3f tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ed7885e7774691b02c19cf08c2177f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d84c59848f445a90eb7eab6be04253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:47:02 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-5b4cf275-536b-4bba-90f5-50867a58ed3f tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c" status: 200 len: 1554 microversion: 2.1 time: 0.306421 Apr 14 18:47:02 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 33/100] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:47:01 2023] GET /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c => generated 1554 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:47:04 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-886a0d5f-f229-4523-8abd-03c3e6298816 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:47:04 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-886a0d5f-f229-4523-8abd-03c3e6298816 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:47:04 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=6 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:47:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-886a0d5f-f229-4523-8abd-03c3e6298816 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-886a0d5f-f229-4523-8abd-03c3e6298816 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-886a0d5f-f229-4523-8abd-03c3e6298816 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-886a0d5f-f229-4523-8abd-03c3e6298816 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-886a0d5f-f229-4523-8abd-03c3e6298816 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-886a0d5f-f229-4523-8abd-03c3e6298816 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:04 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=14 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:47:05 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-886a0d5f-f229-4523-8abd-03c3e6298816 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:47:05 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-886a0d5f-f229-4523-8abd-03c3e6298816 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 200 len: 1539 microversion: 2.1 time: 0.749295 Apr 14 18:47:05 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 35/101] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:47:04 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 1539 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:47:09 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-62eb38ad-959a-4040-b144-61690a60b691 req-f0040058-df6d-4384-b6dd-7422c6f61d8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "tag": "6690e4a9-1979-4050-a6cc-b8fb4c413d24"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:47:09 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=8 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:47:09 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=5 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:47:09 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-62eb38ad-959a-4040-b144-61690a60b691 req-f0040058-df6d-4384-b6dd-7422c6f61d8a service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:09 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-62eb38ad-959a-4040-b144-61690a60b691 req-f0040058-df6d-4384-b6dd-7422c6f61d8a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:09 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-62eb38ad-959a-4040-b144-61690a60b691 req-f0040058-df6d-4384-b6dd-7422c6f61d8a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:09 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-62eb38ad-959a-4040-b144-61690a60b691 req-f0040058-df6d-4384-b6dd-7422c6f61d8a service nova] Creating event network-changed:6690e4a9-1979-4050-a6cc-b8fb4c413d24 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:47:09 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-62eb38ad-959a-4040-b144-61690a60b691 req-f0040058-df6d-4384-b6dd-7422c6f61d8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105361 Apr 14 18:47:09 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 34/102] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:47:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:47:10 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-1d4a1e12-0692-4a87-bb80-ab5e2d498d89 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Action: 'create', calling method: .version_select at 0x7fdae16a31c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-299923261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfCIaR3De/nNGfooewBKCs9Yqqif5k/8sNuCO7uN+hT9gFX4X7nnxenq2rxaGh4ksI9KaiGl0rKmMnWTxru18ybbLxqXOX8NwZxXuMtVOfaCykoVao1yh+Ul0yBt13edA=="}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:47:10 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-1d4a1e12-0692-4a87-bb80-ab5e2d498d89 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Getting quotas for project 8e6b4e98cf9e4f96b79c3288dfe0da89. Resources: {'key_pairs'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:47:10 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-1d4a1e12-0692-4a87-bb80-ab5e2d498d89 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Getting quotas for user 67e1d31c2d9048699758779dedf7d3ac and project 8e6b4e98cf9e4f96b79c3288dfe0da89. Resources: {'key_pairs'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:47:10 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-1d4a1e12-0692-4a87-bb80-ab5e2d498d89 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.065692 Apr 14 18:47:10 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 34/103] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 18:47:10 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:47:10 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1753205108", "imageRef": "9c46cc77-fd07-48b5-b135-2c845b3f989e", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-299923261", "networks": [{"uuid": "abf4a6b2-999d-423c-8c7b-f0f773160410"}]}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:47:10 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:47:10 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=6 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:47:10 user devstack@n-api.service[61675]: DEBUG nova.network.neutron [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] validate_networks() for [('abf4a6b2-999d-423c-8c7b-f0f773160410', None, None, None, None, None)] {{(pid=61675) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:47:11 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Flavor limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:47:11 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Image limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:47:11 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Flavor pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:47:11 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Image pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:47:11 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:47:11 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-6e9b0062-ecd9-4849-823c-e742d163055a req-f55767b6-07c5-4df7-89ab-826bf05358d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "tag": "83687b87-4245-4c8f-9a7e-d18dd00942d3"}, {"name": "network-changed", "server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "tag": "d30907fa-2785-4ffe-8552-7221fbff7200"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:47:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:11 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-6e9b0062-ecd9-4849-823c-e742d163055a req-f55767b6-07c5-4df7-89ab-826bf05358d7 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:11 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-6e9b0062-ecd9-4849-823c-e742d163055a req-f55767b6-07c5-4df7-89ab-826bf05358d7 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:11 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-6e9b0062-ecd9-4849-823c-e742d163055a req-f55767b6-07c5-4df7-89ab-826bf05358d7 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:11 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-6e9b0062-ecd9-4849-823c-e742d163055a req-f55767b6-07c5-4df7-89ab-826bf05358d7 service nova] Creating event network-changed:83687b87-4245-4c8f-9a7e-d18dd00942d3 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:47:11 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-6e9b0062-ecd9-4849-823c-e742d163055a req-f55767b6-07c5-4df7-89ab-826bf05358d7 service nova] Creating event network-changed:d30907fa-2785-4ffe-8552-7221fbff7200 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:47:11 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Getting quotas for project 8e6b4e98cf9e4f96b79c3288dfe0da89. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:47:11 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-6e9b0062-ecd9-4849-823c-e742d163055a req-f55767b6-07c5-4df7-89ab-826bf05358d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036829 Apr 14 18:47:11 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 35/104] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:47:11 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:47:11 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Getting quotas for user 67e1d31c2d9048699758779dedf7d3ac and project 8e6b4e98cf9e4f96b79c3288dfe0da89. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:47:11 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Going to run 1 instances... {{(pid=61675) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:47:11 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9c46cc77-fd07-48b5-b135-2c845b3f989e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:47:11 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.652649 Apr 14 18:47:11 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 36/105] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:47:10 2023] POST /compute/v2.1/servers => generated 378 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:47:11 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-9530b4b4-70c5-48e1-87c3-e18868fecc5a tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:47:11 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-9530b4b4-70c5-48e1-87c3-e18868fecc5a tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:47:11 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-9530b4b4-70c5-48e1-87c3-e18868fecc5a tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e1d31c2d9048699758779dedf7d3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6b4e98cf9e4f96b79c3288dfe0da89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:47:11 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-9530b4b4-70c5-48e1-87c3-e18868fecc5a tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae" status: 200 len: 1252 microversion: 2.1 time: 0.077202 Apr 14 18:47:11 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 35/106] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:47:11 2023] GET /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae => generated 1252 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:47:13 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-9b0585f8-4098-436f-b8d1-2ffbc249bd1a req-f4ef8fa1-4ed7-4aa5-a500-15c47675e613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "tag": "1e979f27-58d7-4973-b70d-f3ca1c5811c5"}, {"name": "network-changed", "server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "tag": "3e05363d-18d0-4fb0-9c3e-40df44246913"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:47:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9b0585f8-4098-436f-b8d1-2ffbc249bd1a req-f4ef8fa1-4ed7-4aa5-a500-15c47675e613 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9b0585f8-4098-436f-b8d1-2ffbc249bd1a req-f4ef8fa1-4ed7-4aa5-a500-15c47675e613 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9b0585f8-4098-436f-b8d1-2ffbc249bd1a req-f4ef8fa1-4ed7-4aa5-a500-15c47675e613 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:13 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-9b0585f8-4098-436f-b8d1-2ffbc249bd1a req-f4ef8fa1-4ed7-4aa5-a500-15c47675e613 service nova] Creating event network-changed:1e979f27-58d7-4973-b70d-f3ca1c5811c5 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:47:13 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-9b0585f8-4098-436f-b8d1-2ffbc249bd1a req-f4ef8fa1-4ed7-4aa5-a500-15c47675e613 service nova] Creating event network-changed:3e05363d-18d0-4fb0-9c3e-40df44246913 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:47:13 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-9b0585f8-4098-436f-b8d1-2ffbc249bd1a req-f4ef8fa1-4ed7-4aa5-a500-15c47675e613 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.052673 Apr 14 18:47:13 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 36/107] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:47:13 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:47:15 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-499188e6-ba65-4718-abc4-a924b2150959 req-fdbe14de-9d96-41a7-b046-527895ae201e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "tag": "b24d8534-70cf-4575-a8f1-f99b5e48b7db"}, {"name": "network-changed", "server_uuid": "656b9f90-ce93-42cd-aa1b-3ff868162aae", "tag": "324b6810-d265-48bc-a2a9-ff7d4759a910"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:47:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-499188e6-ba65-4718-abc4-a924b2150959 req-fdbe14de-9d96-41a7-b046-527895ae201e service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-499188e6-ba65-4718-abc4-a924b2150959 req-fdbe14de-9d96-41a7-b046-527895ae201e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-499188e6-ba65-4718-abc4-a924b2150959 req-fdbe14de-9d96-41a7-b046-527895ae201e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:15 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-499188e6-ba65-4718-abc4-a924b2150959 req-fdbe14de-9d96-41a7-b046-527895ae201e service nova] Creating event network-changed:b24d8534-70cf-4575-a8f1-f99b5e48b7db for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:47:15 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-499188e6-ba65-4718-abc4-a924b2150959 req-fdbe14de-9d96-41a7-b046-527895ae201e service nova] Creating event network-changed:324b6810-d265-48bc-a2a9-ff7d4759a910 for instance 656b9f90-ce93-42cd-aa1b-3ff868162aae on user Apr 14 18:47:15 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-499188e6-ba65-4718-abc4-a924b2150959 req-fdbe14de-9d96-41a7-b046-527895ae201e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.032079 Apr 14 18:47:15 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 37/108] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:47:15 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:47:17 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=30 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:47:17 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-5ddd7efe-526c-48ed-b940-bc4952316e96 req-60ff5f66-fb0d-4e6b-bfab-627a16eb111f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "tag": "85e8f915-2217-47d4-a9a8-74be630b2b10"}, {"server_uuid": "656b9f90-ce93-42cd-aa1b-3ff868162aae", "name": "network-vif-plugged", "status": "completed", "tag": "324b6810-d265-48bc-a2a9-ff7d4759a910"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:47:17 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-5ddd7efe-526c-48ed-b940-bc4952316e96 req-60ff5f66-fb0d-4e6b-bfab-627a16eb111f service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:17 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-5ddd7efe-526c-48ed-b940-bc4952316e96 req-60ff5f66-fb0d-4e6b-bfab-627a16eb111f service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:17 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-5ddd7efe-526c-48ed-b940-bc4952316e96 req-60ff5f66-fb0d-4e6b-bfab-627a16eb111f service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:17 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-5ddd7efe-526c-48ed-b940-bc4952316e96 req-60ff5f66-fb0d-4e6b-bfab-627a16eb111f service nova] Creating event network-changed:85e8f915-2217-47d4-a9a8-74be630b2b10 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:47:17 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-5ddd7efe-526c-48ed-b940-bc4952316e96 req-60ff5f66-fb0d-4e6b-bfab-627a16eb111f service nova] Creating event network-vif-plugged:324b6810-d265-48bc-a2a9-ff7d4759a910 for instance 656b9f90-ce93-42cd-aa1b-3ff868162aae on user Apr 14 18:47:17 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-5ddd7efe-526c-48ed-b940-bc4952316e96 req-60ff5f66-fb0d-4e6b-bfab-627a16eb111f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.042922 Apr 14 18:47:17 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 36/109] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:47:17 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:47:17 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1069322477", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "networks": [{"uuid": "6b3ed1e9-fed5-460b-be16-649f80f8992d"}]}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:47:18 user devstack@n-api.service[61673]: DEBUG nova.network.neutron [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] validate_networks() for [('6b3ed1e9-fed5-460b-be16-649f80f8992d', None, None, None, None, None)] {{(pid=61673) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:47:18 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Flavor limits 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:47:18 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Image limits 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:47:18 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Flavor pref 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:47:18 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Image pref 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:47:18 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:47:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:18 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Getting quotas for project 95319509fb6a4e58998703975370877a. Resources: {'ram', 'instances', 'cores'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:47:18 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Getting quotas for user 1f3f788e144c46e7bdf6f4fe3a5aeb79 and project 95319509fb6a4e58998703975370877a. Resources: {'ram', 'instances', 'cores'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:47:18 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Going to run 1 instances... {{(pid=61673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:47:18 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:47:18 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.695839 Apr 14 18:47:18 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 37/110] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:47:17 2023] POST /compute/v2.1/servers => generated 378 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:47:18 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-eee421de-b0d9-4cde-8d9c-1c00048cabd0 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:47:18 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-eee421de-b0d9-4cde-8d9c-1c00048cabd0 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:47:18 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-eee421de-b0d9-4cde-8d9c-1c00048cabd0 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3f788e144c46e7bdf6f4fe3a5aeb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95319509fb6a4e58998703975370877a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:47:18 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-eee421de-b0d9-4cde-8d9c-1c00048cabd0 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c4f47d7-95da-4a01-b6e6-eb14933fede7" status: 200 len: 1213 microversion: 2.1 time: 0.083891 Apr 14 18:47:18 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 38/111] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:47:18 2023] GET /compute/v2.1/servers/2c4f47d7-95da-4a01-b6e6-eb14933fede7 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:47:19 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-50039d5e-c76e-4553-8491-5b6babb68ab6 req-3b8d93b9-69e1-47fc-9297-206d154b540b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "656b9f90-ce93-42cd-aa1b-3ff868162aae", "name": "network-vif-plugged", "status": "completed", "tag": "324b6810-d265-48bc-a2a9-ff7d4759a910"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:47:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-50039d5e-c76e-4553-8491-5b6babb68ab6 req-3b8d93b9-69e1-47fc-9297-206d154b540b service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-50039d5e-c76e-4553-8491-5b6babb68ab6 req-3b8d93b9-69e1-47fc-9297-206d154b540b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-50039d5e-c76e-4553-8491-5b6babb68ab6 req-3b8d93b9-69e1-47fc-9297-206d154b540b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:19 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-50039d5e-c76e-4553-8491-5b6babb68ab6 req-3b8d93b9-69e1-47fc-9297-206d154b540b service nova] Creating event network-vif-plugged:324b6810-d265-48bc-a2a9-ff7d4759a910 for instance 656b9f90-ce93-42cd-aa1b-3ff868162aae on user Apr 14 18:47:19 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-50039d5e-c76e-4553-8491-5b6babb68ab6 req-3b8d93b9-69e1-47fc-9297-206d154b540b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031539 Apr 14 18:47:19 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 37/112] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:47:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:47:21 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-fa4f94f7-dc93-482e-871d-600ebcfa8dd1 req-882ed8f7-eff9-4417-b255-76f1b7f7329b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c4f47d7-95da-4a01-b6e6-eb14933fede7", "tag": "58380bee-fc13-4cb4-880d-8f6ce124b16f"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:47:21 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-fa4f94f7-dc93-482e-871d-600ebcfa8dd1 req-882ed8f7-eff9-4417-b255-76f1b7f7329b service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:21 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-fa4f94f7-dc93-482e-871d-600ebcfa8dd1 req-882ed8f7-eff9-4417-b255-76f1b7f7329b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:21 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-fa4f94f7-dc93-482e-871d-600ebcfa8dd1 req-882ed8f7-eff9-4417-b255-76f1b7f7329b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:21 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-fa4f94f7-dc93-482e-871d-600ebcfa8dd1 req-882ed8f7-eff9-4417-b255-76f1b7f7329b service nova] Creating event network-changed:58380bee-fc13-4cb4-880d-8f6ce124b16f for instance 2c4f47d7-95da-4a01-b6e6-eb14933fede7 on user Apr 14 18:47:21 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-fa4f94f7-dc93-482e-871d-600ebcfa8dd1 req-882ed8f7-eff9-4417-b255-76f1b7f7329b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041770 Apr 14 18:47:21 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 38/113] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:47:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:47:24 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:47:24 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-29edb05e-a7ae-4fee-aeb3-738a913708ed req-a6c02575-e314-470e-a28b-291618a6ac72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4f47d7-95da-4a01-b6e6-eb14933fede7", "name": "network-vif-plugged", "status": "completed", "tag": "58380bee-fc13-4cb4-880d-8f6ce124b16f"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:47:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-29edb05e-a7ae-4fee-aeb3-738a913708ed req-a6c02575-e314-470e-a28b-291618a6ac72 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-29edb05e-a7ae-4fee-aeb3-738a913708ed req-a6c02575-e314-470e-a28b-291618a6ac72 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-29edb05e-a7ae-4fee-aeb3-738a913708ed req-a6c02575-e314-470e-a28b-291618a6ac72 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:24 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-29edb05e-a7ae-4fee-aeb3-738a913708ed req-a6c02575-e314-470e-a28b-291618a6ac72 service nova] Creating event network-vif-plugged:58380bee-fc13-4cb4-880d-8f6ce124b16f for instance 2c4f47d7-95da-4a01-b6e6-eb14933fede7 on user Apr 14 18:47:24 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-29edb05e-a7ae-4fee-aeb3-738a913708ed req-a6c02575-e314-470e-a28b-291618a6ac72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043078 Apr 14 18:47:24 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 39/114] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:47:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:47:26 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=6 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:47:26 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-b2f541e4-328d-40c2-9bd5-84b473f5a557 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:47:26 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-b2f541e4-328d-40c2-9bd5-84b473f5a557 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:47:26 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b2f541e4-328d-40c2-9bd5-84b473f5a557 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:26 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b2f541e4-328d-40c2-9bd5-84b473f5a557 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:26 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b2f541e4-328d-40c2-9bd5-84b473f5a557 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:26 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b2f541e4-328d-40c2-9bd5-84b473f5a557 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:26 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b2f541e4-328d-40c2-9bd5-84b473f5a557 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:26 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b2f541e4-328d-40c2-9bd5-84b473f5a557 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:26 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-e2c0a6c0-f6c1-4617-a428-9e97237e0507 req-0232c4a7-465c-4189-8f94-0710242deeea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4f47d7-95da-4a01-b6e6-eb14933fede7", "name": "network-vif-plugged", "status": "completed", "tag": "58380bee-fc13-4cb4-880d-8f6ce124b16f"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:47:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-e2c0a6c0-f6c1-4617-a428-9e97237e0507 req-0232c4a7-465c-4189-8f94-0710242deeea service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-e2c0a6c0-f6c1-4617-a428-9e97237e0507 req-0232c4a7-465c-4189-8f94-0710242deeea service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-e2c0a6c0-f6c1-4617-a428-9e97237e0507 req-0232c4a7-465c-4189-8f94-0710242deeea service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:26 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-e2c0a6c0-f6c1-4617-a428-9e97237e0507 req-0232c4a7-465c-4189-8f94-0710242deeea service nova] Creating event network-vif-plugged:58380bee-fc13-4cb4-880d-8f6ce124b16f for instance 2c4f47d7-95da-4a01-b6e6-eb14933fede7 on user Apr 14 18:47:26 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-e2c0a6c0-f6c1-4617-a428-9e97237e0507 req-0232c4a7-465c-4189-8f94-0710242deeea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042771 Apr 14 18:47:26 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 39/115] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:47:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:47:26 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-b2f541e4-328d-40c2-9bd5-84b473f5a557 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f78850ecd8042dbac5f24113b9df70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22a362d9cb946a99c203366f88baafb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:47:26 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-b2f541e4-328d-40c2-9bd5-84b473f5a557 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/817f112c-d806-4800-9e4a-a3892c54bee1" status: 200 len: 1543 microversion: 2.1 time: 0.226616 Apr 14 18:47:26 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 38/116] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:47:26 2023] GET /compute/v2.1/servers/817f112c-d806-4800-9e4a-a3892c54bee1 => generated 1543 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:47:27 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-0c3e836b-464b-4c8b-aa32-e3460c934e19 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:47:27 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-0c3e836b-464b-4c8b-aa32-e3460c934e19 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:47:27 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0c3e836b-464b-4c8b-aa32-e3460c934e19 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:27 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0c3e836b-464b-4c8b-aa32-e3460c934e19 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:27 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0c3e836b-464b-4c8b-aa32-e3460c934e19 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:27 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0c3e836b-464b-4c8b-aa32-e3460c934e19 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:27 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0c3e836b-464b-4c8b-aa32-e3460c934e19 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:27 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0c3e836b-464b-4c8b-aa32-e3460c934e19 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:28 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-0c3e836b-464b-4c8b-aa32-e3460c934e19 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6224225e832d40e986e1f145295621df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef3347089a742cd8533322deb96b4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:47:28 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-0c3e836b-464b-4c8b-aa32-e3460c934e19 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] 10.0.0.210 "GET /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8" status: 200 len: 1549 microversion: 2.1 time: 0.245677 Apr 14 18:47:28 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 40/117] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:47:27 2023] GET /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8 => generated 1549 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:47:30 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-9eceecd4-1be0-42ba-856c-9802ea38cd70 req-b4598649-59b1-4e0d-9356-592012d176b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-plugged", "status": "completed", "tag": "6690e4a9-1979-4050-a6cc-b8fb4c413d24"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:47:30 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:47:30 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=7 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:47:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9eceecd4-1be0-42ba-856c-9802ea38cd70 req-b4598649-59b1-4e0d-9356-592012d176b9 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9eceecd4-1be0-42ba-856c-9802ea38cd70 req-b4598649-59b1-4e0d-9356-592012d176b9 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9eceecd4-1be0-42ba-856c-9802ea38cd70 req-b4598649-59b1-4e0d-9356-592012d176b9 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:31 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-9eceecd4-1be0-42ba-856c-9802ea38cd70 req-b4598649-59b1-4e0d-9356-592012d176b9 service nova] Creating event network-vif-plugged:6690e4a9-1979-4050-a6cc-b8fb4c413d24 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:47:31 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-9eceecd4-1be0-42ba-856c-9802ea38cd70 req-b4598649-59b1-4e0d-9356-592012d176b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082266 Apr 14 18:47:31 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 40/118] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:47:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:47:31 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-a441e8b9-d713-4384-b954-bcaa96a9cc2b req-0e21d089-7eca-45ee-9cb8-93960aba9ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-plugged", "status": "completed", "tag": "83687b87-4245-4c8f-9a7e-d18dd00942d3"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:47:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-a441e8b9-d713-4384-b954-bcaa96a9cc2b req-0e21d089-7eca-45ee-9cb8-93960aba9ae8 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-a441e8b9-d713-4384-b954-bcaa96a9cc2b req-0e21d089-7eca-45ee-9cb8-93960aba9ae8 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-a441e8b9-d713-4384-b954-bcaa96a9cc2b req-0e21d089-7eca-45ee-9cb8-93960aba9ae8 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:31 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-a441e8b9-d713-4384-b954-bcaa96a9cc2b req-0e21d089-7eca-45ee-9cb8-93960aba9ae8 service nova] Creating event network-vif-plugged:83687b87-4245-4c8f-9a7e-d18dd00942d3 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:47:31 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-a441e8b9-d713-4384-b954-bcaa96a9cc2b req-0e21d089-7eca-45ee-9cb8-93960aba9ae8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039176 Apr 14 18:47:31 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 39/119] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:47:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:47:32 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-add7bf06-7f66-489e-a7d9-7c2c9fecf5e4 req-6a909062-b9a6-4b3c-9a5a-a35a9466d5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-plugged", "status": "completed", "tag": "3e05363d-18d0-4fb0-9c3e-40df44246913"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:47:32 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=8 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:47:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-add7bf06-7f66-489e-a7d9-7c2c9fecf5e4 req-6a909062-b9a6-4b3c-9a5a-a35a9466d5d2 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-add7bf06-7f66-489e-a7d9-7c2c9fecf5e4 req-6a909062-b9a6-4b3c-9a5a-a35a9466d5d2 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-add7bf06-7f66-489e-a7d9-7c2c9fecf5e4 req-6a909062-b9a6-4b3c-9a5a-a35a9466d5d2 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:32 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-add7bf06-7f66-489e-a7d9-7c2c9fecf5e4 req-6a909062-b9a6-4b3c-9a5a-a35a9466d5d2 service nova] Creating event network-vif-plugged:3e05363d-18d0-4fb0-9c3e-40df44246913 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:47:32 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-add7bf06-7f66-489e-a7d9-7c2c9fecf5e4 req-6a909062-b9a6-4b3c-9a5a-a35a9466d5d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083819 Apr 14 18:47:32 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 41/120] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:47:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:47:33 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-5950cee0-4e0e-4c72-a969-c2168efaee37 req-374a1c15-b863-451b-aeeb-61243958b153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-plugged", "status": "completed", "tag": "6690e4a9-1979-4050-a6cc-b8fb4c413d24"}, {"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-plugged", "status": "completed", "tag": "d30907fa-2785-4ffe-8552-7221fbff7200"}, {"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-plugged", "status": "completed", "tag": "d30907fa-2785-4ffe-8552-7221fbff7200"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:47:33 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-5950cee0-4e0e-4c72-a969-c2168efaee37 req-374a1c15-b863-451b-aeeb-61243958b153 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:33 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-5950cee0-4e0e-4c72-a969-c2168efaee37 req-374a1c15-b863-451b-aeeb-61243958b153 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:33 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-5950cee0-4e0e-4c72-a969-c2168efaee37 req-374a1c15-b863-451b-aeeb-61243958b153 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:33 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-5950cee0-4e0e-4c72-a969-c2168efaee37 req-374a1c15-b863-451b-aeeb-61243958b153 service nova] Creating event network-vif-plugged:6690e4a9-1979-4050-a6cc-b8fb4c413d24 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:47:33 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-5950cee0-4e0e-4c72-a969-c2168efaee37 req-374a1c15-b863-451b-aeeb-61243958b153 service nova] Creating event network-vif-plugged:d30907fa-2785-4ffe-8552-7221fbff7200 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:47:33 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-5950cee0-4e0e-4c72-a969-c2168efaee37 req-374a1c15-b863-451b-aeeb-61243958b153 service nova] Creating event network-vif-plugged:d30907fa-2785-4ffe-8552-7221fbff7200 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:47:33 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-5950cee0-4e0e-4c72-a969-c2168efaee37 req-374a1c15-b863-451b-aeeb-61243958b153 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.056137 Apr 14 18:47:33 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 41/121] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:47:33 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:47:33 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-plugged", "status": "completed", "tag": "83687b87-4245-4c8f-9a7e-d18dd00942d3"}, {"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-plugged", "status": "completed", "tag": "1e979f27-58d7-4973-b70d-f3ca1c5811c5"}, {"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-plugged", "status": "completed", "tag": "1e979f27-58d7-4973-b70d-f3ca1c5811c5"}, {"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-plugged", "status": "completed", "tag": "b24d8534-70cf-4575-a8f1-f99b5e48b7db"}, {"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-plugged", "status": "completed", "tag": "b24d8534-70cf-4575-a8f1-f99b5e48b7db"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:47:33 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:47:33 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:33 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:33 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:33 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] Creating event network-vif-plugged:83687b87-4245-4c8f-9a7e-d18dd00942d3 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:47:33 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] Creating event network-vif-plugged:1e979f27-58d7-4973-b70d-f3ca1c5811c5 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:47:33 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] Creating event network-vif-plugged:1e979f27-58d7-4973-b70d-f3ca1c5811c5 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:47:33 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] Creating event network-vif-plugged:b24d8534-70cf-4575-a8f1-f99b5e48b7db for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:47:33 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] Creating event network-vif-plugged:b24d8534-70cf-4575-a8f1-f99b5e48b7db for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:47:33 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.075437 Apr 14 18:47:33 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 40/122] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:47:33 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:47:34 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-20d3bbe0-5cb4-4fba-a102-6bd9e70e1da1 req-f76574e4-69bf-4447-a158-dd80fa99d231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-plugged", "status": "completed", "tag": "3e05363d-18d0-4fb0-9c3e-40df44246913"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:47:34 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:47:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-20d3bbe0-5cb4-4fba-a102-6bd9e70e1da1 req-f76574e4-69bf-4447-a158-dd80fa99d231 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-20d3bbe0-5cb4-4fba-a102-6bd9e70e1da1 req-f76574e4-69bf-4447-a158-dd80fa99d231 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-20d3bbe0-5cb4-4fba-a102-6bd9e70e1da1 req-f76574e4-69bf-4447-a158-dd80fa99d231 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:34 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=20 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:47:34 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-20d3bbe0-5cb4-4fba-a102-6bd9e70e1da1 req-f76574e4-69bf-4447-a158-dd80fa99d231 service nova] Creating event network-vif-plugged:3e05363d-18d0-4fb0-9c3e-40df44246913 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:47:34 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-20d3bbe0-5cb4-4fba-a102-6bd9e70e1da1 req-f76574e4-69bf-4447-a158-dd80fa99d231 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035392 Apr 14 18:47:34 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 42/123] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:47:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:47:35 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-6bc1864d-c54d-47d6-9383-39ed48a5ce22 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:47:35 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-6bc1864d-c54d-47d6-9383-39ed48a5ce22 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:47:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6bc1864d-c54d-47d6-9383-39ed48a5ce22 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6bc1864d-c54d-47d6-9383-39ed48a5ce22 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6bc1864d-c54d-47d6-9383-39ed48a5ce22 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6bc1864d-c54d-47d6-9383-39ed48a5ce22 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6bc1864d-c54d-47d6-9383-39ed48a5ce22 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6bc1864d-c54d-47d6-9383-39ed48a5ce22 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:35 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-6bc1864d-c54d-47d6-9383-39ed48a5ce22 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b083d961ab7546a7bb743d034c5e0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efae74f239e14c29b3af28c7fceee94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:47:35 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-6bc1864d-c54d-47d6-9383-39ed48a5ce22 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b083d961ab7546a7bb743d034c5e0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efae74f239e14c29b3af28c7fceee94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:47:35 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-6bc1864d-c54d-47d6-9383-39ed48a5ce22 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b083d961ab7546a7bb743d034c5e0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efae74f239e14c29b3af28c7fceee94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:47:35 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-6bc1864d-c54d-47d6-9383-39ed48a5ce22 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" status: 200 len: 1628 microversion: 2.49 time: 0.377241 Apr 14 18:47:35 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 42/124] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:47:35 2023] GET /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 => generated 1628 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:47:35 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-872337cc-6e1e-415e-8698-deeaafa382c6 req-16731eef-a351-4591-aeef-4549bf63f2bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-plugged", "status": "completed", "tag": "85e8f915-2217-47d4-a9a8-74be630b2b10"}, {"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-plugged", "status": "completed", "tag": "85e8f915-2217-47d4-a9a8-74be630b2b10"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:47:35 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-872337cc-6e1e-415e-8698-deeaafa382c6 req-16731eef-a351-4591-aeef-4549bf63f2bd service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:35 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-872337cc-6e1e-415e-8698-deeaafa382c6 req-16731eef-a351-4591-aeef-4549bf63f2bd service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:35 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-872337cc-6e1e-415e-8698-deeaafa382c6 req-16731eef-a351-4591-aeef-4549bf63f2bd service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:35 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-872337cc-6e1e-415e-8698-deeaafa382c6 req-16731eef-a351-4591-aeef-4549bf63f2bd service nova] Creating event network-vif-plugged:85e8f915-2217-47d4-a9a8-74be630b2b10 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:47:35 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-872337cc-6e1e-415e-8698-deeaafa382c6 req-16731eef-a351-4591-aeef-4549bf63f2bd service nova] Creating event network-vif-plugged:85e8f915-2217-47d4-a9a8-74be630b2b10 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:47:35 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-872337cc-6e1e-415e-8698-deeaafa382c6 req-16731eef-a351-4591-aeef-4549bf63f2bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067757 Apr 14 18:47:35 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 41/125] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:47:35 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:47:38 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-eb306c71-bb71-4e7e-b520-bfb960835a00 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:47:38 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-eb306c71-bb71-4e7e-b520-bfb960835a00 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:47:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-eb306c71-bb71-4e7e-b520-bfb960835a00 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-eb306c71-bb71-4e7e-b520-bfb960835a00 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-eb306c71-bb71-4e7e-b520-bfb960835a00 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-eb306c71-bb71-4e7e-b520-bfb960835a00 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-eb306c71-bb71-4e7e-b520-bfb960835a00 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-eb306c71-bb71-4e7e-b520-bfb960835a00 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:38 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-eb306c71-bb71-4e7e-b520-bfb960835a00 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb40ab30d44d5ebd26c3956b6d7e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418926b6689d48e3b7288ce32834dc93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:47:38 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-eb306c71-bb71-4e7e-b520-bfb960835a00 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6" status: 200 len: 1523 microversion: 2.1 time: 0.247239 Apr 14 18:47:38 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 43/126] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:47:38 2023] GET /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6 => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:47:50 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-84ae994f-a844-49c1-8f9f-ac0c0504d018 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:47:50 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-84ae994f-a844-49c1-8f9f-ac0c0504d018 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:47:50 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:47:50 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=22 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:47:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-84ae994f-a844-49c1-8f9f-ac0c0504d018 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-84ae994f-a844-49c1-8f9f-ac0c0504d018 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-84ae994f-a844-49c1-8f9f-ac0c0504d018 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-84ae994f-a844-49c1-8f9f-ac0c0504d018 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-84ae994f-a844-49c1-8f9f-ac0c0504d018 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-84ae994f-a844-49c1-8f9f-ac0c0504d018 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:50 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-84ae994f-a844-49c1-8f9f-ac0c0504d018 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4dc36f0048042929d1230f99e2be306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ec916e861d448a853251f522699446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:47:50 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-84ae994f-a844-49c1-8f9f-ac0c0504d018 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4dc36f0048042929d1230f99e2be306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ec916e861d448a853251f522699446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:47:50 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-84ae994f-a844-49c1-8f9f-ac0c0504d018 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4dc36f0048042929d1230f99e2be306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ec916e861d448a853251f522699446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:47:50 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-84ae994f-a844-49c1-8f9f-ac0c0504d018 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3378ec4-364a-4656-ac99-500be9d40749" status: 200 len: 2826 microversion: 2.32 time: 0.439883 Apr 14 18:47:50 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 43/127] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:47:50 2023] GET /compute/v2.1/servers/a3378ec4-364a-4656-ac99-500be9d40749 => generated 2826 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:47:53 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=3 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:47:53 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=16 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:47:53 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-531925342"}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:47:53 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:47:53 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:53 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:53 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:53 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:53 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:53 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:53 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "POST /compute/v2.1/servers/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/action" status: 202 len: 52 microversion: 2.87 time: 0.813480 Apr 14 18:47:53 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 42/128] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 18:47:53 2023] POST /compute/v2.1/servers/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/action => generated 52 bytes in 815 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 14 18:47:59 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-3f71095e-9b18-45cd-8607-4e7917390ff0 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:47:59 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-3f71095e-9b18-45cd-8607-4e7917390ff0 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:47:59 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=3 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:47:59 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=7 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:47:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3f71095e-9b18-45cd-8607-4e7917390ff0 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3f71095e-9b18-45cd-8607-4e7917390ff0 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3f71095e-9b18-45cd-8607-4e7917390ff0 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3f71095e-9b18-45cd-8607-4e7917390ff0 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3f71095e-9b18-45cd-8607-4e7917390ff0 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3f71095e-9b18-45cd-8607-4e7917390ff0 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:59 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-3f71095e-9b18-45cd-8607-4e7917390ff0 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:47:59 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-3f71095e-9b18-45cd-8607-4e7917390ff0 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:47:59 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-3f71095e-9b18-45cd-8607-4e7917390ff0 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:47:59 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-3f71095e-9b18-45cd-8607-4e7917390ff0 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" status: 200 len: 1690 microversion: 2.87 time: 0.305420 Apr 14 18:47:59 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 44/129] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:47:59 2023] GET /compute/v2.1/servers/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 => generated 1690 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 18:47:59 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-b6e73889-dcfe-4d12-b43c-7fe60b7e8b26 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:47:59 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-b6e73889-dcfe-4d12-b43c-7fe60b7e8b26 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:47:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b6e73889-dcfe-4d12-b43c-7fe60b7e8b26 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b6e73889-dcfe-4d12-b43c-7fe60b7e8b26 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b6e73889-dcfe-4d12-b43c-7fe60b7e8b26 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b6e73889-dcfe-4d12-b43c-7fe60b7e8b26 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:47:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b6e73889-dcfe-4d12-b43c-7fe60b7e8b26 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:47:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b6e73889-dcfe-4d12-b43c-7fe60b7e8b26 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:47:59 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-b6e73889-dcfe-4d12-b43c-7fe60b7e8b26 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.211463 Apr 14 18:47:59 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 44/130] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 18:47:59 2023] GET /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c/os-interface => generated 283 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:00 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92fae690-8b67-45c0-b93c-b2915ea3a57e"}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:00 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:00 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] 10.0.0.210 "POST /compute/v2.1/servers/849b47d6-c267-420e-bb09-e43e33ad1df1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.392230 Apr 14 18:48:00 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 43/131] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 18:48:00 2023] POST /compute/v2.1/servers/849b47d6-c267-420e-bb09-e43e33ad1df1/os-volume_attachments => generated 194 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:01 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-edfcb1db-7f56-4b7d-a556-f732cfb00131 req-6237ba71-adea-46f4-8f71-8a9bf1bb8f7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "094a4a33-569e-4137-8798-743499f1046c", "tag": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-edfcb1db-7f56-4b7d-a556-f732cfb00131 req-6237ba71-adea-46f4-8f71-8a9bf1bb8f7a service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-edfcb1db-7f56-4b7d-a556-f732cfb00131 req-6237ba71-adea-46f4-8f71-8a9bf1bb8f7a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-edfcb1db-7f56-4b7d-a556-f732cfb00131 req-6237ba71-adea-46f4-8f71-8a9bf1bb8f7a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:01 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-edfcb1db-7f56-4b7d-a556-f732cfb00131 req-6237ba71-adea-46f4-8f71-8a9bf1bb8f7a service nova] Creating event network-changed:940c6edd-6fc7-4e88-92b4-38a62e88f2ab for instance 094a4a33-569e-4137-8798-743499f1046c on user Apr 14 18:48:01 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-edfcb1db-7f56-4b7d-a556-f732cfb00131 req-6237ba71-adea-46f4-8f71-8a9bf1bb8f7a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031354 Apr 14 18:48:01 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 45/132] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:48:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:01 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-df0d2aa5-d72e-4cf2-90f5-4092ad9961ce tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:01 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-df0d2aa5-d72e-4cf2-90f5-4092ad9961ce tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-df0d2aa5-d72e-4cf2-90f5-4092ad9961ce tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-df0d2aa5-d72e-4cf2-90f5-4092ad9961ce tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-df0d2aa5-d72e-4cf2-90f5-4092ad9961ce tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-df0d2aa5-d72e-4cf2-90f5-4092ad9961ce tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-df0d2aa5-d72e-4cf2-90f5-4092ad9961ce tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-df0d2aa5-d72e-4cf2-90f5-4092ad9961ce tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:01 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-df0d2aa5-d72e-4cf2-90f5-4092ad9961ce tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c/ips" status: 200 len: 108 microversion: 2.1 time: 0.040567 Apr 14 18:48:01 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 45/133] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 18:48:01 2023] GET /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c/ips => generated 108 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:01 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-d5982919-41fc-40f7-88b1-9eba6de7d475 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:01 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-d5982919-41fc-40f7-88b1-9eba6de7d475 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d5982919-41fc-40f7-88b1-9eba6de7d475 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d5982919-41fc-40f7-88b1-9eba6de7d475 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d5982919-41fc-40f7-88b1-9eba6de7d475 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d5982919-41fc-40f7-88b1-9eba6de7d475 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d5982919-41fc-40f7-88b1-9eba6de7d475 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d5982919-41fc-40f7-88b1-9eba6de7d475 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:01 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-d5982919-41fc-40f7-88b1-9eba6de7d475 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e1d31c2d9048699758779dedf7d3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6b4e98cf9e4f96b79c3288dfe0da89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:48:01 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-d5982919-41fc-40f7-88b1-9eba6de7d475 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae" status: 200 len: 1536 microversion: 2.1 time: 0.240185 Apr 14 18:48:01 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 44/134] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:48:01 2023] GET /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae => generated 1536 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:48:02 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-d7e41dd3-5e29-4f17-ab26-f1e12bd7a418 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:02 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-d7e41dd3-5e29-4f17-ab26-f1e12bd7a418 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d7e41dd3-5e29-4f17-ab26-f1e12bd7a418 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d7e41dd3-5e29-4f17-ab26-f1e12bd7a418 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d7e41dd3-5e29-4f17-ab26-f1e12bd7a418 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d7e41dd3-5e29-4f17-ab26-f1e12bd7a418 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d7e41dd3-5e29-4f17-ab26-f1e12bd7a418 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d7e41dd3-5e29-4f17-ab26-f1e12bd7a418 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:02 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-d7e41dd3-5e29-4f17-ab26-f1e12bd7a418 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.209606 Apr 14 18:48:02 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 46/135] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 18:48:02 2023] GET /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c/os-interface => generated 282 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:03 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-4b9aa67c-92a7-4547-a2d9-f8f9aef02f58 req-348a5973-4e3a-420c-b71d-dcbef5978180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e55c721-9fad-4478-9e74-e87d0c95bc3c", "tag": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:03 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-4b9aa67c-92a7-4547-a2d9-f8f9aef02f58 req-348a5973-4e3a-420c-b71d-dcbef5978180 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:03 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-4b9aa67c-92a7-4547-a2d9-f8f9aef02f58 req-348a5973-4e3a-420c-b71d-dcbef5978180 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:03 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-4b9aa67c-92a7-4547-a2d9-f8f9aef02f58 req-348a5973-4e3a-420c-b71d-dcbef5978180 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:03 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-4b9aa67c-92a7-4547-a2d9-f8f9aef02f58 req-348a5973-4e3a-420c-b71d-dcbef5978180 service nova] Creating event network-changed:66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c on user Apr 14 18:48:03 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-4b9aa67c-92a7-4547-a2d9-f8f9aef02f58 req-348a5973-4e3a-420c-b71d-dcbef5978180 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036698 Apr 14 18:48:03 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 46/136] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:48:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:03 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1945746357"}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:03 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:03 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:03 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:03 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:03 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:03 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:03 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:03 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8000d5a4-c39b-41b5-a47c-0f83b55fa0ab"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:03 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:04 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "POST /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.619492 Apr 14 18:48:04 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 47/137] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 18:48:03 2023] POST /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c/os-volume_attachments => generated 194 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:04 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c/action" status: 202 len: 0 microversion: 2.1 time: 0.836331 Apr 14 18:48:04 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 45/138] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 18:48:03 2023] POST /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c/action => generated 0 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 18:48:04 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-a42418c7-07d7-4f2a-8c24-400e54c4695f tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Calling method '.version_select at 0x7fdae1632170>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:04 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-a42418c7-07d7-4f2a-8c24-400e54c4695f tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 10.0.0.210 "GET /compute/v2.1/images/6e8245ec-8367-4bce-99df-352eae7f4ed7" status: 200 len: 1609 microversion: 2.1 time: 0.059030 Apr 14 18:48:04 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 47/139] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 18:48:04 2023] GET /compute/v2.1/images/6e8245ec-8367-4bce-99df-352eae7f4ed7 => generated 1609 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:48:05 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-5879f756-e19a-43ac-8f5a-bc2268924503 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:05 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-5879f756-e19a-43ac-8f5a-bc2268924503 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-5879f756-e19a-43ac-8f5a-bc2268924503 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-5879f756-e19a-43ac-8f5a-bc2268924503 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-5879f756-e19a-43ac-8f5a-bc2268924503 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-5879f756-e19a-43ac-8f5a-bc2268924503 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-5879f756-e19a-43ac-8f5a-bc2268924503 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-5879f756-e19a-43ac-8f5a-bc2268924503 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:05 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-5879f756-e19a-43ac-8f5a-bc2268924503 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.280033 Apr 14 18:48:05 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 48/140] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 18:48:05 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be/os-interface => generated 282 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:06 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-7976fb39-5a9d-4dd2-8a26-0df3e543c265 req-a0145900-5a68-49e7-b4b2-49b1dfb58c16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa09363f-435d-4fa8-9f11-db0c3f4e08be", "tag": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-7976fb39-5a9d-4dd2-8a26-0df3e543c265 req-a0145900-5a68-49e7-b4b2-49b1dfb58c16 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-7976fb39-5a9d-4dd2-8a26-0df3e543c265 req-a0145900-5a68-49e7-b4b2-49b1dfb58c16 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-7976fb39-5a9d-4dd2-8a26-0df3e543c265 req-a0145900-5a68-49e7-b4b2-49b1dfb58c16 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:06 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-7976fb39-5a9d-4dd2-8a26-0df3e543c265 req-a0145900-5a68-49e7-b4b2-49b1dfb58c16 service nova] Creating event network-changed:2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance aa09363f-435d-4fa8-9f11-db0c3f4e08be on user Apr 14 18:48:06 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-7976fb39-5a9d-4dd2-8a26-0df3e543c265 req-a0145900-5a68-49e7-b4b2-49b1dfb58c16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035269 Apr 14 18:48:06 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 46/141] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:48:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:06 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-465b4504-5984-4f1c-9d48-a2dcbd397b50 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:06 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-465b4504-5984-4f1c-9d48-a2dcbd397b50 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-465b4504-5984-4f1c-9d48-a2dcbd397b50 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-465b4504-5984-4f1c-9d48-a2dcbd397b50 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-465b4504-5984-4f1c-9d48-a2dcbd397b50 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-465b4504-5984-4f1c-9d48-a2dcbd397b50 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-465b4504-5984-4f1c-9d48-a2dcbd397b50 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-465b4504-5984-4f1c-9d48-a2dcbd397b50 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:07 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-465b4504-5984-4f1c-9d48-a2dcbd397b50 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:48:07 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-465b4504-5984-4f1c-9d48-a2dcbd397b50 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 200 len: 1539 microversion: 2.1 time: 0.695875 Apr 14 18:48:07 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 48/142] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:48:06 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 1539 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:48:07 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-fb7cdbba-80cb-42d3-b473-8740dbf05733 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:07 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-fb7cdbba-80cb-42d3-b473-8740dbf05733 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fb7cdbba-80cb-42d3-b473-8740dbf05733 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fb7cdbba-80cb-42d3-b473-8740dbf05733 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fb7cdbba-80cb-42d3-b473-8740dbf05733 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fb7cdbba-80cb-42d3-b473-8740dbf05733 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fb7cdbba-80cb-42d3-b473-8740dbf05733 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fb7cdbba-80cb-42d3-b473-8740dbf05733 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:07 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-fb7cdbba-80cb-42d3-b473-8740dbf05733 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:48:07 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-fb7cdbba-80cb-42d3-b473-8740dbf05733 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 200 len: 1656 microversion: 2.1 time: 0.398695 Apr 14 18:48:07 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 49/143] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:48:07 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 1656 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 18:48:07 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-6214b377-92bd-4b8e-bf0e-9fcc6591ae81 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:07 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-6214b377-92bd-4b8e-bf0e-9fcc6591ae81 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:07 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6214b377-92bd-4b8e-bf0e-9fcc6591ae81 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:07 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6214b377-92bd-4b8e-bf0e-9fcc6591ae81 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:07 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6214b377-92bd-4b8e-bf0e-9fcc6591ae81 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:07 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6214b377-92bd-4b8e-bf0e-9fcc6591ae81 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:07 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6214b377-92bd-4b8e-bf0e-9fcc6591ae81 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:07 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6214b377-92bd-4b8e-bf0e-9fcc6591ae81 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:07 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-6214b377-92bd-4b8e-bf0e-9fcc6591ae81 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:48:07 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-6214b377-92bd-4b8e-bf0e-9fcc6591ae81 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 200 len: 1656 microversion: 2.1 time: 0.160085 Apr 14 18:48:07 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 47/144] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:48:07 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 1656 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:48:08 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:08 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:08 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Going to try to terminate instance {{(pid=61673) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 18:48:08 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/849b47d6-c267-420e-bb09-e43e33ad1df1" status: 204 len: 0 microversion: 2.1 time: 0.155556 Apr 14 18:48:08 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 49/145] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 18:48:08 2023] DELETE /compute/v2.1/servers/849b47d6-c267-420e-bb09-e43e33ad1df1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 18:48:08 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-ccf24c7d-301d-42ad-be5a-a70ef0163aec tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:08 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-ccf24c7d-301d-42ad-be5a-a70ef0163aec tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ccf24c7d-301d-42ad-be5a-a70ef0163aec tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ccf24c7d-301d-42ad-be5a-a70ef0163aec tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ccf24c7d-301d-42ad-be5a-a70ef0163aec tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ccf24c7d-301d-42ad-be5a-a70ef0163aec tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ccf24c7d-301d-42ad-be5a-a70ef0163aec tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ccf24c7d-301d-42ad-be5a-a70ef0163aec tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:08 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-ccf24c7d-301d-42ad-be5a-a70ef0163aec tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a860138cfc74444a78dc1e456a9d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f259dc787d468596879969e33f2e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:48:08 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-3d4ee332-5c52-40cd-a7b6-5aa428e38850 req-e48b2378-2f5f-4346-8621-039b5c036228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "849b47d6-c267-420e-bb09-e43e33ad1df1", "name": "network-vif-unplugged", "status": "completed", "tag": "29b77a39-c2df-45c1-83ea-72ffe0a24460"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:08 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-ccf24c7d-301d-42ad-be5a-a70ef0163aec tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] 10.0.0.210 "GET /compute/v2.1/servers/849b47d6-c267-420e-bb09-e43e33ad1df1" status: 200 len: 1541 microversion: 2.1 time: 0.279703 Apr 14 18:48:08 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 50/146] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:48:08 2023] GET /compute/v2.1/servers/849b47d6-c267-420e-bb09-e43e33ad1df1 => generated 1541 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:48:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-3d4ee332-5c52-40cd-a7b6-5aa428e38850 req-e48b2378-2f5f-4346-8621-039b5c036228 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-3d4ee332-5c52-40cd-a7b6-5aa428e38850 req-e48b2378-2f5f-4346-8621-039b5c036228 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-3d4ee332-5c52-40cd-a7b6-5aa428e38850 req-e48b2378-2f5f-4346-8621-039b5c036228 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:08 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-3d4ee332-5c52-40cd-a7b6-5aa428e38850 req-e48b2378-2f5f-4346-8621-039b5c036228 service nova] Creating event network-vif-unplugged:29b77a39-c2df-45c1-83ea-72ffe0a24460 for instance 849b47d6-c267-420e-bb09-e43e33ad1df1 on user Apr 14 18:48:08 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-3d4ee332-5c52-40cd-a7b6-5aa428e38850 req-e48b2378-2f5f-4346-8621-039b5c036228 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036128 Apr 14 18:48:08 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 48/147] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:48:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:08 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-a3e764aa-ce8a-41ad-9ba5-9a6cb146bd3d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:08 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-a3e764aa-ce8a-41ad-9ba5-9a6cb146bd3d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a3e764aa-ce8a-41ad-9ba5-9a6cb146bd3d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a3e764aa-ce8a-41ad-9ba5-9a6cb146bd3d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a3e764aa-ce8a-41ad-9ba5-9a6cb146bd3d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a3e764aa-ce8a-41ad-9ba5-9a6cb146bd3d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a3e764aa-ce8a-41ad-9ba5-9a6cb146bd3d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a3e764aa-ce8a-41ad-9ba5-9a6cb146bd3d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:09 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-a3e764aa-ce8a-41ad-9ba5-9a6cb146bd3d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3f788e144c46e7bdf6f4fe3a5aeb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95319509fb6a4e58998703975370877a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:48:09 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-a3e764aa-ce8a-41ad-9ba5-9a6cb146bd3d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c4f47d7-95da-4a01-b6e6-eb14933fede7" status: 200 len: 1496 microversion: 2.1 time: 0.258633 Apr 14 18:48:09 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 50/148] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:48:08 2023] GET /compute/v2.1/servers/2c4f47d7-95da-4a01-b6e6-eb14933fede7 => generated 1496 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 18:48:10 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-56cf62b0-84d3-4afb-ba74-d9d171c23f88 req-09e8bb10-4d11-49c2-b5eb-6664d91c5a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "849b47d6-c267-420e-bb09-e43e33ad1df1", "name": "network-vif-deleted", "tag": "29b77a39-c2df-45c1-83ea-72ffe0a24460"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-56cf62b0-84d3-4afb-ba74-d9d171c23f88 req-09e8bb10-4d11-49c2-b5eb-6664d91c5a04 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-56cf62b0-84d3-4afb-ba74-d9d171c23f88 req-09e8bb10-4d11-49c2-b5eb-6664d91c5a04 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-56cf62b0-84d3-4afb-ba74-d9d171c23f88 req-09e8bb10-4d11-49c2-b5eb-6664d91c5a04 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:10 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-56cf62b0-84d3-4afb-ba74-d9d171c23f88 req-09e8bb10-4d11-49c2-b5eb-6664d91c5a04 service nova] Creating event network-vif-deleted:29b77a39-c2df-45c1-83ea-72ffe0a24460 for instance 849b47d6-c267-420e-bb09-e43e33ad1df1 on user Apr 14 18:48:10 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-56cf62b0-84d3-4afb-ba74-d9d171c23f88 req-09e8bb10-4d11-49c2-b5eb-6664d91c5a04 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032610 Apr 14 18:48:10 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 51/149] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:48:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:10 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-92c8f3e9-e25c-4921-9bea-cbfb85bc41d5 req-a32702ca-4f28-44a0-9666-76dd1bf594c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "849b47d6-c267-420e-bb09-e43e33ad1df1", "name": "network-vif-plugged", "status": "completed", "tag": "29b77a39-c2df-45c1-83ea-72ffe0a24460"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:10 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-92c8f3e9-e25c-4921-9bea-cbfb85bc41d5 req-a32702ca-4f28-44a0-9666-76dd1bf594c4 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:10 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-92c8f3e9-e25c-4921-9bea-cbfb85bc41d5 req-a32702ca-4f28-44a0-9666-76dd1bf594c4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:10 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-92c8f3e9-e25c-4921-9bea-cbfb85bc41d5 req-a32702ca-4f28-44a0-9666-76dd1bf594c4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:10 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-92c8f3e9-e25c-4921-9bea-cbfb85bc41d5 req-a32702ca-4f28-44a0-9666-76dd1bf594c4 service nova] Creating event network-vif-plugged:29b77a39-c2df-45c1-83ea-72ffe0a24460 for instance 849b47d6-c267-420e-bb09-e43e33ad1df1 on user Apr 14 18:48:10 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-92c8f3e9-e25c-4921-9bea-cbfb85bc41d5 req-a32702ca-4f28-44a0-9666-76dd1bf594c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034110 Apr 14 18:48:10 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 49/150] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:48:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:12 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-7a27852c-b870-45e6-b6ad-42d6647874a4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Action: 'create', calling method: .version_select at 0x7fdae1630700>, body: {"keypair": {"name": "tempest-keypair-1533000139", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv5tcWUysgHNjqS8vIJY6wuxptnW7SVWtpF8Vm4ifl+8f/mUTKLgZGllDwY5TPms5tlvjb7AnrxpIcD8irOHwpoEkzOiACF26K/c654rXUweH7qfR4k/mAAGTe7KExSjg=="}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:12 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-7a27852c-b870-45e6-b6ad-42d6647874a4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Getting quotas for project e34cdebcd7154988a957deae140e8eab. Resources: {'key_pairs'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:48:12 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-7a27852c-b870-45e6-b6ad-42d6647874a4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Getting quotas for user 8d53edaffb8f4038abd366d7942c6bc7 and project e34cdebcd7154988a957deae140e8eab. Resources: {'key_pairs'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:48:12 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-7a27852c-b870-45e6-b6ad-42d6647874a4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057620 Apr 14 18:48:12 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 51/151] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 18:48:12 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:13 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1130291892", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ebff2aa0-97cc-48ab-8839-3dff795a5b06"}], "security_groups": [{"name": "tempest-securitygroup--33142145"}], "key_name": "tempest-keypair-1533000139", "user_data": "}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:13 user devstack@n-api.service[61675]: DEBUG nova.network.neutron [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] validate_networks() for [('ebff2aa0-97cc-48ab-8839-3dff795a5b06', None, None, None, None, None)] {{(pid=61675) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:48:14 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Flavor limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:48:14 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Image limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:48:14 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Flavor pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:48:14 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Image pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:48:14 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:48:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:14 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Getting quotas for project e34cdebcd7154988a957deae140e8eab. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:48:14 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Getting quotas for user 8d53edaffb8f4038abd366d7942c6bc7 and project e34cdebcd7154988a957deae140e8eab. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:48:14 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Going to run 1 instances... {{(pid=61675) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:48:14 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:48:14 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 398 microversion: 2.1 time: 1.031605 Apr 14 18:48:14 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 52/152] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:48:13 2023] POST /compute/v2.1/servers => generated 398 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:48:14 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-ff5b6cc4-dedd-4898-a13d-8de06faa7cc9 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:14 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-ff5b6cc4-dedd-4898-a13d-8de06faa7cc9 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:14 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-ff5b6cc4-dedd-4898-a13d-8de06faa7cc9 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d53edaffb8f4038abd366d7942c6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34cdebcd7154988a957deae140e8eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:48:14 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-ff5b6cc4-dedd-4898-a13d-8de06faa7cc9 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9" status: 200 len: 1236 microversion: 2.1 time: 0.068811 Apr 14 18:48:14 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 50/153] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:48:14 2023] GET /compute/v2.1/servers/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:48:17 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-4981946f-dae8-402f-9b0d-c509486df16f req-71e5768b-74a6-45f3-98dd-9f5ed4d2cb2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9", "tag": "c5adcd6e-6277-40d5-8d78-4df9155319ba"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:17 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-4981946f-dae8-402f-9b0d-c509486df16f req-71e5768b-74a6-45f3-98dd-9f5ed4d2cb2e service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:17 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-4981946f-dae8-402f-9b0d-c509486df16f req-71e5768b-74a6-45f3-98dd-9f5ed4d2cb2e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:17 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-4981946f-dae8-402f-9b0d-c509486df16f req-71e5768b-74a6-45f3-98dd-9f5ed4d2cb2e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:17 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-4981946f-dae8-402f-9b0d-c509486df16f req-71e5768b-74a6-45f3-98dd-9f5ed4d2cb2e service nova] Creating event network-changed:c5adcd6e-6277-40d5-8d78-4df9155319ba for instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 on user Apr 14 18:48:17 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-4981946f-dae8-402f-9b0d-c509486df16f req-71e5768b-74a6-45f3-98dd-9f5ed4d2cb2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040285 Apr 14 18:48:17 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 52/154] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:48:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:19 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-98318ef7-a9fb-48c4-86db-57c2fbf11478 req-fd18832a-44b7-4e29-81ba-55d050c7716d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9", "name": "network-vif-plugged", "status": "completed", "tag": "c5adcd6e-6277-40d5-8d78-4df9155319ba"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-98318ef7-a9fb-48c4-86db-57c2fbf11478 req-fd18832a-44b7-4e29-81ba-55d050c7716d service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-98318ef7-a9fb-48c4-86db-57c2fbf11478 req-fd18832a-44b7-4e29-81ba-55d050c7716d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-98318ef7-a9fb-48c4-86db-57c2fbf11478 req-fd18832a-44b7-4e29-81ba-55d050c7716d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:19 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-98318ef7-a9fb-48c4-86db-57c2fbf11478 req-fd18832a-44b7-4e29-81ba-55d050c7716d service nova] Creating event network-vif-plugged:c5adcd6e-6277-40d5-8d78-4df9155319ba for instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 on user Apr 14 18:48:19 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-98318ef7-a9fb-48c4-86db-57c2fbf11478 req-fd18832a-44b7-4e29-81ba-55d050c7716d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041395 Apr 14 18:48:19 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 53/155] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:48:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:21 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-7aef9ef7-28bd-43c9-ae22-bef5e47fe25a req-385050bb-3f35-43fa-b9a1-a57250223829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9", "name": "network-vif-plugged", "status": "completed", "tag": "c5adcd6e-6277-40d5-8d78-4df9155319ba"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:21 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:48:21 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-7aef9ef7-28bd-43c9-ae22-bef5e47fe25a req-385050bb-3f35-43fa-b9a1-a57250223829 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:21 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-7aef9ef7-28bd-43c9-ae22-bef5e47fe25a req-385050bb-3f35-43fa-b9a1-a57250223829 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:21 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-7aef9ef7-28bd-43c9-ae22-bef5e47fe25a req-385050bb-3f35-43fa-b9a1-a57250223829 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:21 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-7aef9ef7-28bd-43c9-ae22-bef5e47fe25a req-385050bb-3f35-43fa-b9a1-a57250223829 service nova] Creating event network-vif-plugged:c5adcd6e-6277-40d5-8d78-4df9155319ba for instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 on user Apr 14 18:48:21 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-7aef9ef7-28bd-43c9-ae22-bef5e47fe25a req-385050bb-3f35-43fa-b9a1-a57250223829 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030679 Apr 14 18:48:21 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 51/156] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:48:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:26 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=4 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:48:26 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-e92a88ba-24b6-4193-9461-5808fb0cebef tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:26 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-e92a88ba-24b6-4193-9461-5808fb0cebef tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:26 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:48:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e92a88ba-24b6-4193-9461-5808fb0cebef tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e92a88ba-24b6-4193-9461-5808fb0cebef tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e92a88ba-24b6-4193-9461-5808fb0cebef tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e92a88ba-24b6-4193-9461-5808fb0cebef tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e92a88ba-24b6-4193-9461-5808fb0cebef tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e92a88ba-24b6-4193-9461-5808fb0cebef tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:26 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:48:27 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-e92a88ba-24b6-4193-9461-5808fb0cebef tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/817f112c-d806-4800-9e4a-a3892c54bee1/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.541175 Apr 14 18:48:27 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 53/157] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 18:48:26 2023] GET /compute/v2.1/servers/817f112c-d806-4800-9e4a-a3892c54bee1/os-interface => generated 283 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:27 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:48:27 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=6 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:48:27 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-40f0dad3-1849-451b-8660-3a53cab7256c req-413c9e7a-5447-421f-9ed0-16672ead3c2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "817f112c-d806-4800-9e4a-a3892c54bee1", "tag": "4a744ab3-b516-4349-adfd-98d2ce4332d2"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:27 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-40f0dad3-1849-451b-8660-3a53cab7256c req-413c9e7a-5447-421f-9ed0-16672ead3c2e service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:27 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-40f0dad3-1849-451b-8660-3a53cab7256c req-413c9e7a-5447-421f-9ed0-16672ead3c2e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:27 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-40f0dad3-1849-451b-8660-3a53cab7256c req-413c9e7a-5447-421f-9ed0-16672ead3c2e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:27 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-40f0dad3-1849-451b-8660-3a53cab7256c req-413c9e7a-5447-421f-9ed0-16672ead3c2e service nova] Creating event network-changed:4a744ab3-b516-4349-adfd-98d2ce4332d2 for instance 817f112c-d806-4800-9e4a-a3892c54bee1 on user Apr 14 18:48:27 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-40f0dad3-1849-451b-8660-3a53cab7256c req-413c9e7a-5447-421f-9ed0-16672ead3c2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037095 Apr 14 18:48:27 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 54/158] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:48:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:28 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:48:28 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-900ff7b7-825c-4f19-a3f5-e97d470970c0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:28 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-900ff7b7-825c-4f19-a3f5-e97d470970c0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:28 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=23 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:48:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-900ff7b7-825c-4f19-a3f5-e97d470970c0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-900ff7b7-825c-4f19-a3f5-e97d470970c0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-900ff7b7-825c-4f19-a3f5-e97d470970c0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-900ff7b7-825c-4f19-a3f5-e97d470970c0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-900ff7b7-825c-4f19-a3f5-e97d470970c0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-900ff7b7-825c-4f19-a3f5-e97d470970c0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:28 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-900ff7b7-825c-4f19-a3f5-e97d470970c0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] 10.0.0.210 "GET /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.264724 Apr 14 18:48:28 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 52/159] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 18:48:28 2023] GET /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8/os-interface => generated 283 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:29 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-ba314f88-f6f3-4675-a0f8-9cf47b43a0c7 req-6f39b401-8f9b-4704-a7d3-40ec2c15182f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "499df49b-4a00-447b-bd2f-b027fb44f3b8", "tag": "51aafe60-87de-4ca9-8168-cbac2aeb557e"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-ba314f88-f6f3-4675-a0f8-9cf47b43a0c7 req-6f39b401-8f9b-4704-a7d3-40ec2c15182f service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-ba314f88-f6f3-4675-a0f8-9cf47b43a0c7 req-6f39b401-8f9b-4704-a7d3-40ec2c15182f service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-ba314f88-f6f3-4675-a0f8-9cf47b43a0c7 req-6f39b401-8f9b-4704-a7d3-40ec2c15182f service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:29 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-ba314f88-f6f3-4675-a0f8-9cf47b43a0c7 req-6f39b401-8f9b-4704-a7d3-40ec2c15182f service nova] Creating event network-changed:51aafe60-87de-4ca9-8168-cbac2aeb557e for instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 on user Apr 14 18:48:29 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-ba314f88-f6f3-4675-a0f8-9cf47b43a0c7 req-6f39b401-8f9b-4704-a7d3-40ec2c15182f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038924 Apr 14 18:48:29 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 54/160] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:48:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 18:48:30 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b3d213e-10a2-47c2-a13e-96b4c199d198"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:30 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:30 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:48:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:30 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:48:30 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] 10.0.0.210 "POST /compute/v2.1/servers/817f112c-d806-4800-9e4a-a3892c54bee1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.414935 Apr 14 18:48:30 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 55/161] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 18:48:30 2023] POST /compute/v2.1/servers/817f112c-d806-4800-9e4a-a3892c54bee1/os-volume_attachments => generated 194 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:31 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9925aa7-e3bf-4bff-ac58-d534eae3beea"}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:31 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:32 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] 10.0.0.210 "POST /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275954 Apr 14 18:48:32 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 53/162] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 18:48:31 2023] POST /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:35 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-af1155c1-985b-412f-a3be-ce82382d1a56 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:35 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-af1155c1-985b-412f-a3be-ce82382d1a56 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-af1155c1-985b-412f-a3be-ce82382d1a56 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-af1155c1-985b-412f-a3be-ce82382d1a56 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-af1155c1-985b-412f-a3be-ce82382d1a56 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-af1155c1-985b-412f-a3be-ce82382d1a56 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-af1155c1-985b-412f-a3be-ce82382d1a56 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-af1155c1-985b-412f-a3be-ce82382d1a56 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:35 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-af1155c1-985b-412f-a3be-ce82382d1a56 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/os-interface" status: 200 len: 283 microversion: 2.49 time: 0.235919 Apr 14 18:48:35 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 55/163] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 18:48:35 2023] GET /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/os-interface => generated 283 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 18:48:36 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-69855225-cef3-4527-91c5-3a8e4620ef73 req-e1f01f39-fd1e-4e3c-a0ab-d682383899b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99", "tag": "a23ae571-1be9-4877-b629-567eb9c62b9d"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:36 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-69855225-cef3-4527-91c5-3a8e4620ef73 req-e1f01f39-fd1e-4e3c-a0ab-d682383899b8 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:36 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-69855225-cef3-4527-91c5-3a8e4620ef73 req-e1f01f39-fd1e-4e3c-a0ab-d682383899b8 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:36 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-69855225-cef3-4527-91c5-3a8e4620ef73 req-e1f01f39-fd1e-4e3c-a0ab-d682383899b8 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:36 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-69855225-cef3-4527-91c5-3a8e4620ef73 req-e1f01f39-fd1e-4e3c-a0ab-d682383899b8 service nova] Creating event network-changed:a23ae571-1be9-4877-b629-567eb9c62b9d for instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 on user Apr 14 18:48:36 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-69855225-cef3-4527-91c5-3a8e4620ef73 req-e1f01f39-fd1e-4e3c-a0ab-d682383899b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050397 Apr 14 18:48:36 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 56/164] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:48:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:37 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-239171e8-ed2f-4b8f-8973-6ce081d723ed tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:37 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-239171e8-ed2f-4b8f-8973-6ce081d723ed tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-239171e8-ed2f-4b8f-8973-6ce081d723ed tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-239171e8-ed2f-4b8f-8973-6ce081d723ed tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-239171e8-ed2f-4b8f-8973-6ce081d723ed tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-239171e8-ed2f-4b8f-8973-6ce081d723ed tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-239171e8-ed2f-4b8f-8973-6ce081d723ed tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-239171e8-ed2f-4b8f-8973-6ce081d723ed tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:37 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-239171e8-ed2f-4b8f-8973-6ce081d723ed tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b083d961ab7546a7bb743d034c5e0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efae74f239e14c29b3af28c7fceee94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:48:37 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-239171e8-ed2f-4b8f-8973-6ce081d723ed tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b083d961ab7546a7bb743d034c5e0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efae74f239e14c29b3af28c7fceee94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:48:37 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-239171e8-ed2f-4b8f-8973-6ce081d723ed tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b083d961ab7546a7bb743d034c5e0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efae74f239e14c29b3af28c7fceee94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:48:37 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-239171e8-ed2f-4b8f-8973-6ce081d723ed tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" status: 200 len: 1628 microversion: 2.49 time: 0.536444 Apr 14 18:48:37 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 54/165] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:48:37 2023] GET /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 => generated 1628 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:48:37 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "ddba4fb2-7f51-4d51-82b8-4eb434448f0b", "tag": "nic-tag"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:37 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:38 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-f6c39f7a-a06a-4a21-bb87-fc544a9a7251 tempest-VolumesAdminNegativeTest-1430126587 tempest-VolumesAdminNegativeTest-1430126587-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "0dde29eb-93c2-45df-bd23-e6e06dd4421c"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:38 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-f6c39f7a-a06a-4a21-bb87-fc544a9a7251 tempest-VolumesAdminNegativeTest-1430126587 tempest-VolumesAdminNegativeTest-1430126587-project-admin] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f6c39f7a-a06a-4a21-bb87-fc544a9a7251 tempest-VolumesAdminNegativeTest-1430126587 tempest-VolumesAdminNegativeTest-1430126587-project-admin] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f6c39f7a-a06a-4a21-bb87-fc544a9a7251 tempest-VolumesAdminNegativeTest-1430126587 tempest-VolumesAdminNegativeTest-1430126587-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f6c39f7a-a06a-4a21-bb87-fc544a9a7251 tempest-VolumesAdminNegativeTest-1430126587 tempest-VolumesAdminNegativeTest-1430126587-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f6c39f7a-a06a-4a21-bb87-fc544a9a7251 tempest-VolumesAdminNegativeTest-1430126587 tempest-VolumesAdminNegativeTest-1430126587-project-admin] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f6c39f7a-a06a-4a21-bb87-fc544a9a7251 tempest-VolumesAdminNegativeTest-1430126587 tempest-VolumesAdminNegativeTest-1430126587-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f6c39f7a-a06a-4a21-bb87-fc544a9a7251 tempest-VolumesAdminNegativeTest-1430126587 tempest-VolumesAdminNegativeTest-1430126587-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:38 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-f6c39f7a-a06a-4a21-bb87-fc544a9a7251 tempest-VolumesAdminNegativeTest-1430126587 tempest-VolumesAdminNegativeTest-1430126587-project-admin] HTTP exception thrown: Volume 0dde29eb-93c2-45df-bd23-e6e06dd4421c could not be found. Apr 14 18:48:38 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-f6c39f7a-a06a-4a21-bb87-fc544a9a7251 tempest-VolumesAdminNegativeTest-1430126587 tempest-VolumesAdminNegativeTest-1430126587-project-admin] Request method failure captured: Apr 14 18:48:38 user devstack@n-api.service[61675]: request: PUT /compute/v2.1/servers/817f112c-d806-4800-9e4a-a3892c54bee1/os-volume_attachments/3b3d213e-10a2-47c2-a13e-96b4c199d198 HTTP/1.1 Apr 14 18:48:38 user devstack@n-api.service[61675]: Accept: application/json Apr 14 18:48:38 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 18:48:38 user devstack@n-api.service[61675]: Connection: close Apr 14 18:48:38 user devstack@n-api.service[61675]: Content-Length: 74 Apr 14 18:48:38 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 18:48:38 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 18:48:38 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 18:48:38 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 18:48:38 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOZ-FTpfNnFyxhHYJ_jxQ1hbgrgtd4k8nVsWkL4N4mZPP5e4Mgja9yh244QBt-D9iNmQ3zmggdtxHubF09LrydVv2TlK8Bvl_cjLW7qmqZ9DfkyCuZd1HrAvru36EwmxK3jQRpdCyUb-OGlowBYM2zTru-mdJaMqVHfFWC9-kT6uyB18 Apr 14 18:48:38 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 18:48:38 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 18:48:38 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 18:48:38 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 18:48:38 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 18:48:38 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 18:48:38 user devstack@n-api.service[61675]: X-Project-Id: 5ea32fe1b14144a5889d4f9756ac49df Apr 14 18:48:38 user devstack@n-api.service[61675]: X-Project-Name: tempest-VolumesAdminNegativeTest-1430126587 Apr 14 18:48:38 user devstack@n-api.service[61675]: X-Role: reader,admin,member Apr 14 18:48:38 user devstack@n-api.service[61675]: X-Roles: reader,admin,member Apr 14 18:48:38 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ea32fe1b14144a5889d4f9756ac49df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ea32fe1b14144a5889d4f9756ac49df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ea32fe1b14144a5889d4f9756ac49df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:48:38 user devstack@n-api.service[61675]: X-Tenant: tempest-VolumesAdminNegativeTest-1430126587 Apr 14 18:48:38 user devstack@n-api.service[61675]: X-Tenant-Id: 5ea32fe1b14144a5889d4f9756ac49df Apr 14 18:48:38 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1430126587 Apr 14 18:48:38 user devstack@n-api.service[61675]: X-User: tempest-VolumesAdminNegativeTest-1430126587-project-admin Apr 14 18:48:38 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 18:48:38 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 18:48:38 user devstack@n-api.service[61675]: X-User-Id: dd44410b3b5d4cb5a6c40843a37c21b2 Apr 14 18:48:38 user devstack@n-api.service[61675]: X-User-Name: tempest-VolumesAdminNegativeTest-1430126587-project-admin Apr 14 18:48:38 user devstack@n-api.service[61675]: Apr 14 18:48:38 user devstack@n-api.service[61675]: {"volumeAttachment": {"volumeId": "0dde29eb-93c2-45df-bd23-e6e06dd4421c"}} Apr 14 18:48:38 user devstack@n-api.service[61675]: method: > Apr 14 18:48:38 user devstack@n-api.service[61675]: exception: Volume 0dde29eb-93c2-45df-bd23-e6e06dd4421c could not be found. Apr 14 18:48:38 user devstack@n-api.service[61675]: action_args: {'server_id': '817f112c-d806-4800-9e4a-a3892c54bee1', 'id': '3b3d213e-10a2-47c2-a13e-96b4c199d198', 'body': {'volumeAttachment': {'volumeId': '0dde29eb-93c2-45df-bd23-e6e06dd4421c'}}} Apr 14 18:48:38 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0dde29eb-93c2-45df-bd23-e6e06dd4421c could not be found. (HTTP 404) (Request-ID: req-4f2cb406-06ad-4b8d-87b9-e48bccbed963) Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0dde29eb-93c2-45df-bd23-e6e06dd4421c could not be found. Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 0dde29eb-93c2-45df-bd23-e6e06dd4421c could not be found. Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0dde29eb-93c2-45df-bd23-e6e06dd4421c could not be found. Apr 14 18:48:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:48:38 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-f6c39f7a-a06a-4a21-bb87-fc544a9a7251 tempest-VolumesAdminNegativeTest-1430126587 tempest-VolumesAdminNegativeTest-1430126587-project-admin] Returning 400 to user: Volume 0dde29eb-93c2-45df-bd23-e6e06dd4421c could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:48:38 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-f6c39f7a-a06a-4a21-bb87-fc544a9a7251 tempest-VolumesAdminNegativeTest-1430126587 tempest-VolumesAdminNegativeTest-1430126587-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/817f112c-d806-4800-9e4a-a3892c54bee1/os-volume_attachments/3b3d213e-10a2-47c2-a13e-96b4c199d198" status: 400 len: 107 microversion: 2.1 time: 0.458134 Apr 14 18:48:38 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 57/166] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 18:48:38 2023] PUT /compute/v2.1/servers/817f112c-d806-4800-9e4a-a3892c54bee1/os-volume_attachments/3b3d213e-10a2-47c2-a13e-96b4c199d198 => generated 107 bytes in 459 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 18:48:38 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:38 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:38 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:38 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:38 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:38 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:38 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:38 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:39 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-08226e12-6db0-4451-afee-23b324d5b74f tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:39 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-08226e12-6db0-4451-afee-23b324d5b74f tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:39 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-08226e12-6db0-4451-afee-23b324d5b74f tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:39 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-08226e12-6db0-4451-afee-23b324d5b74f tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:39 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-08226e12-6db0-4451-afee-23b324d5b74f tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:39 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-08226e12-6db0-4451-afee-23b324d5b74f tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:39 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-08226e12-6db0-4451-afee-23b324d5b74f tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:39 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-08226e12-6db0-4451-afee-23b324d5b74f tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:39 user devstack@n-api.service[61674]: DEBUG nova.objects.instance [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lazy-loading 'services' on Instance uuid 817f112c-d806-4800-9e4a-a3892c54bee1 {{(pid=61674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 18:48:39 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/817f112c-d806-4800-9e4a-a3892c54bee1/os-volume_attachments/3b3d213e-10a2-47c2-a13e-96b4c199d198" status: 202 len: 0 microversion: 2.1 time: 0.239502 Apr 14 18:48:39 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 55/167] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 18:48:38 2023] DELETE /compute/v2.1/servers/817f112c-d806-4800-9e4a-a3892c54bee1/os-volume_attachments/3b3d213e-10a2-47c2-a13e-96b4c199d198 => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:48:39 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-c89fcb35-7b0f-4c8f-a9aa-7c468a40b580 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:39 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-c89fcb35-7b0f-4c8f-a9aa-7c468a40b580 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:39 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c89fcb35-7b0f-4c8f-a9aa-7c468a40b580 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:39 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c89fcb35-7b0f-4c8f-a9aa-7c468a40b580 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:39 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c89fcb35-7b0f-4c8f-a9aa-7c468a40b580 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:39 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c89fcb35-7b0f-4c8f-a9aa-7c468a40b580 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:39 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c89fcb35-7b0f-4c8f-a9aa-7c468a40b580 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:39 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c89fcb35-7b0f-4c8f-a9aa-7c468a40b580 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:39 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-08226e12-6db0-4451-afee-23b324d5b74f tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.192416 Apr 14 18:48:39 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 58/168] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 18:48:39 2023] GET /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6/os-interface => generated 283 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:39 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-c89fcb35-7b0f-4c8f-a9aa-7c468a40b580 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/817f112c-d806-4800-9e4a-a3892c54bee1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050992 Apr 14 18:48:39 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 56/169] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:48:39 2023] GET /compute/v2.1/servers/817f112c-d806-4800-9e4a-a3892c54bee1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:39 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-9339b02f-f44d-472f-acc9-30867c4545ae req-31daae50-e120-48b4-bb56-0d4dd6f0948e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99", "tag": "29934039-40ef-4f75-a712-55b7ab72c0b0"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:39 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-9339b02f-f44d-472f-acc9-30867c4545ae req-31daae50-e120-48b4-bb56-0d4dd6f0948e service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:39 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-9339b02f-f44d-472f-acc9-30867c4545ae req-31daae50-e120-48b4-bb56-0d4dd6f0948e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:39 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-9339b02f-f44d-472f-acc9-30867c4545ae req-31daae50-e120-48b4-bb56-0d4dd6f0948e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:39 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-9339b02f-f44d-472f-acc9-30867c4545ae req-31daae50-e120-48b4-bb56-0d4dd6f0948e service nova] Creating event network-changed:29934039-40ef-4f75-a712-55b7ab72c0b0 for instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 on user Apr 14 18:48:39 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-9339b02f-f44d-472f-acc9-30867c4545ae req-31daae50-e120-48b4-bb56-0d4dd6f0948e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029831 Apr 14 18:48:39 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 59/170] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:48:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:39 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-693741a8-a21e-4c48-ace9-92064617d31d tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:39 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-693741a8-a21e-4c48-ace9-92064617d31d tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:39 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-693741a8-a21e-4c48-ace9-92064617d31d tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:39 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-693741a8-a21e-4c48-ace9-92064617d31d tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:39 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-693741a8-a21e-4c48-ace9-92064617d31d tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:39 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-693741a8-a21e-4c48-ace9-92064617d31d tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:39 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-693741a8-a21e-4c48-ace9-92064617d31d tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:39 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-693741a8-a21e-4c48-ace9-92064617d31d tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:39 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-693741a8-a21e-4c48-ace9-92064617d31d tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] 10.0.0.210 "GET /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047293 Apr 14 18:48:39 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 57/171] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:48:39 2023] GET /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:39 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:39 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:39 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:39 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:39 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:39 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:39 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:39 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:39 user devstack@n-api.service[61675]: DEBUG nova.objects.instance [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lazy-loading 'services' on Instance uuid 499df49b-4a00-447b-bd2f-b027fb44f3b8 {{(pid=61675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 18:48:40 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-816418e7-5f30-495a-a20a-dd72a687daf2 req-e38154ec-014b-4d29-8863-900285d3f41d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e03adca9-8b0c-416c-943e-7dce251547c6", "tag": "fd4a0af3-b371-4b85-8a45-3b68d9884358"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-816418e7-5f30-495a-a20a-dd72a687daf2 req-e38154ec-014b-4d29-8863-900285d3f41d service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-816418e7-5f30-495a-a20a-dd72a687daf2 req-e38154ec-014b-4d29-8863-900285d3f41d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-816418e7-5f30-495a-a20a-dd72a687daf2 req-e38154ec-014b-4d29-8863-900285d3f41d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:40 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-816418e7-5f30-495a-a20a-dd72a687daf2 req-e38154ec-014b-4d29-8863-900285d3f41d service nova] Creating event network-changed:fd4a0af3-b371-4b85-8a45-3b68d9884358 for instance e03adca9-8b0c-416c-943e-7dce251547c6 on user Apr 14 18:48:40 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-816418e7-5f30-495a-a20a-dd72a687daf2 req-e38154ec-014b-4d29-8863-900285d3f41d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042605 Apr 14 18:48:40 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 58/172] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:48:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 18:48:40 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba2fc051-881a-4012-af7c-22007cc56d3b"}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:40 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:40 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8/os-volume_attachments/d9925aa7-e3bf-4bff-ac58-d534eae3beea" status: 202 len: 0 microversion: 2.1 time: 0.297587 Apr 14 18:48:40 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 60/173] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 18:48:39 2023] DELETE /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8/os-volume_attachments/d9925aa7-e3bf-4bff-ac58-d534eae3beea => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:48:40 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.494386 Apr 14 18:48:40 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 59/174] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 18:48:40 2023] POST /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6/os-volume_attachments => generated 194 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:41 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:41 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/os-interface" status: 200 len: 281 microversion: 2.49 time: 3.917024 Apr 14 18:48:41 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 56/175] 10.0.0.210 () {66 vars in 1414 bytes} [Fri Apr 14 18:48:37 2023] POST /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/os-interface => generated 281 bytes in 3919 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 18:48:41 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "786535d2-c800-442a-bc6d-c788f7b28bdf", "tag": "volume-tag"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:41 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:41 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-26318216-e550-4557-af4b-12fa35147538 req-17236375-f91c-4a3f-86cd-7fc04d0ffa08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99", "name": "network-vif-plugged", "status": "completed", "tag": "29934039-40ef-4f75-a712-55b7ab72c0b0"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-26318216-e550-4557-af4b-12fa35147538 req-17236375-f91c-4a3f-86cd-7fc04d0ffa08 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-26318216-e550-4557-af4b-12fa35147538 req-17236375-f91c-4a3f-86cd-7fc04d0ffa08 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-26318216-e550-4557-af4b-12fa35147538 req-17236375-f91c-4a3f-86cd-7fc04d0ffa08 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:41 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-26318216-e550-4557-af4b-12fa35147538 req-17236375-f91c-4a3f-86cd-7fc04d0ffa08 service nova] Creating event network-vif-plugged:29934039-40ef-4f75-a712-55b7ab72c0b0 for instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 on user Apr 14 18:48:41 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-26318216-e550-4557-af4b-12fa35147538 req-17236375-f91c-4a3f-86cd-7fc04d0ffa08 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035854 Apr 14 18:48:41 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 60/176] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:48:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 18:48:41 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.383219 Apr 14 18:48:41 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 61/177] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 18:48:41 2023] POST /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/os-volume_attachments => generated 194 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 18:48:42 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-98dfa36d-8e16-41a8-a927-bfea1b404b7e tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:42 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-98dfa36d-8e16-41a8-a927-bfea1b404b7e tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-98dfa36d-8e16-41a8-a927-bfea1b404b7e tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-98dfa36d-8e16-41a8-a927-bfea1b404b7e tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-98dfa36d-8e16-41a8-a927-bfea1b404b7e tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-98dfa36d-8e16-41a8-a927-bfea1b404b7e tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-98dfa36d-8e16-41a8-a927-bfea1b404b7e tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-98dfa36d-8e16-41a8-a927-bfea1b404b7e tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:42 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-98dfa36d-8e16-41a8-a927-bfea1b404b7e tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] 10.0.0.210 "GET /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057445 Apr 14 18:48:42 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 57/178] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:48:42 2023] GET /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 18:48:42 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-b37723cb-1b5e-4783-8dc2-182f7275038d tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:42 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-b37723cb-1b5e-4783-8dc2-182f7275038d tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b37723cb-1b5e-4783-8dc2-182f7275038d tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b37723cb-1b5e-4783-8dc2-182f7275038d tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b37723cb-1b5e-4783-8dc2-182f7275038d tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b37723cb-1b5e-4783-8dc2-182f7275038d tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b37723cb-1b5e-4783-8dc2-182f7275038d tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b37723cb-1b5e-4783-8dc2-182f7275038d tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:42 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-b37723cb-1b5e-4783-8dc2-182f7275038d tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] 10.0.0.210 "GET /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047623 Apr 14 18:48:42 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 61/179] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:48:42 2023] GET /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 18:48:42 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:42 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:42 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Going to try to terminate instance {{(pid=61675) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 18:48:42 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8" status: 204 len: 0 microversion: 2.1 time: 0.135257 Apr 14 18:48:42 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 62/180] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 18:48:42 2023] DELETE /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 18:48:42 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-b18ecc95-552e-45a9-91ea-13c6c262bc71 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:42 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-b18ecc95-552e-45a9-91ea-13c6c262bc71 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b18ecc95-552e-45a9-91ea-13c6c262bc71 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b18ecc95-552e-45a9-91ea-13c6c262bc71 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b18ecc95-552e-45a9-91ea-13c6c262bc71 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b18ecc95-552e-45a9-91ea-13c6c262bc71 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b18ecc95-552e-45a9-91ea-13c6c262bc71 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b18ecc95-552e-45a9-91ea-13c6c262bc71 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:42 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-b18ecc95-552e-45a9-91ea-13c6c262bc71 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6224225e832d40e986e1f145295621df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef3347089a742cd8533322deb96b4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:48:42 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-b18ecc95-552e-45a9-91ea-13c6c262bc71 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] 10.0.0.210 "GET /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8" status: 200 len: 1674 microversion: 2.1 time: 0.268484 Apr 14 18:48:42 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 58/181] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:48:42 2023] GET /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8 => generated 1674 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:48:43 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-d9ec8ae5-4a11-47fe-97c7-dfe34aaea381 req-338de4a8-76af-4e7d-86cf-2843e2ae38c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99", "name": "network-vif-plugged", "status": "completed", "tag": "29934039-40ef-4f75-a712-55b7ab72c0b0"}, {"server_uuid": "499df49b-4a00-447b-bd2f-b027fb44f3b8", "name": "network-vif-unplugged", "status": "completed", "tag": "51aafe60-87de-4ca9-8168-cbac2aeb557e"}, {"server_uuid": "499df49b-4a00-447b-bd2f-b027fb44f3b8", "name": "network-vif-plugged", "status": "completed", "tag": "51aafe60-87de-4ca9-8168-cbac2aeb557e"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-d9ec8ae5-4a11-47fe-97c7-dfe34aaea381 req-338de4a8-76af-4e7d-86cf-2843e2ae38c0 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-d9ec8ae5-4a11-47fe-97c7-dfe34aaea381 req-338de4a8-76af-4e7d-86cf-2843e2ae38c0 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-d9ec8ae5-4a11-47fe-97c7-dfe34aaea381 req-338de4a8-76af-4e7d-86cf-2843e2ae38c0 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:43 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-d9ec8ae5-4a11-47fe-97c7-dfe34aaea381 req-338de4a8-76af-4e7d-86cf-2843e2ae38c0 service nova] Creating event network-vif-plugged:29934039-40ef-4f75-a712-55b7ab72c0b0 for instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 on user Apr 14 18:48:43 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-d9ec8ae5-4a11-47fe-97c7-dfe34aaea381 req-338de4a8-76af-4e7d-86cf-2843e2ae38c0 service nova] Creating event network-vif-unplugged:51aafe60-87de-4ca9-8168-cbac2aeb557e for instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 on user Apr 14 18:48:43 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-d9ec8ae5-4a11-47fe-97c7-dfe34aaea381 req-338de4a8-76af-4e7d-86cf-2843e2ae38c0 service nova] Creating event network-vif-plugged:51aafe60-87de-4ca9-8168-cbac2aeb557e for instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 on user Apr 14 18:48:43 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-d9ec8ae5-4a11-47fe-97c7-dfe34aaea381 req-338de4a8-76af-4e7d-86cf-2843e2ae38c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.033405 Apr 14 18:48:43 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 62/182] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:48:43 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:45 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-5ba675f4-d779-431b-92c8-ed7d40c00fd1 req-66b8dd44-fc7e-4aa0-9ae3-a449a18f7c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "499df49b-4a00-447b-bd2f-b027fb44f3b8", "name": "network-vif-deleted", "tag": "51aafe60-87de-4ca9-8168-cbac2aeb557e"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:45 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-5ba675f4-d779-431b-92c8-ed7d40c00fd1 req-66b8dd44-fc7e-4aa0-9ae3-a449a18f7c5f service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:45 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-5ba675f4-d779-431b-92c8-ed7d40c00fd1 req-66b8dd44-fc7e-4aa0-9ae3-a449a18f7c5f service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:45 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-5ba675f4-d779-431b-92c8-ed7d40c00fd1 req-66b8dd44-fc7e-4aa0-9ae3-a449a18f7c5f service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:45 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-5ba675f4-d779-431b-92c8-ed7d40c00fd1 req-66b8dd44-fc7e-4aa0-9ae3-a449a18f7c5f service nova] Creating event network-vif-deleted:51aafe60-87de-4ca9-8168-cbac2aeb557e for instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 on user Apr 14 18:48:45 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-5ba675f4-d779-431b-92c8-ed7d40c00fd1 req-66b8dd44-fc7e-4aa0-9ae3-a449a18f7c5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035573 Apr 14 18:48:45 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 63/183] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:48:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:48 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "7646c367-81d4-43cd-bb7a-97ecdd4f9576"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:48 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:48 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:48 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:48 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:48 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:48 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:48 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:48 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6/os-volume_attachments/ba2fc051-881a-4012-af7c-22007cc56d3b" status: 202 len: 0 microversion: 2.1 time: 0.507826 Apr 14 18:48:48 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 59/184] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 18:48:48 2023] PUT /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6/os-volume_attachments/ba2fc051-881a-4012-af7c-22007cc56d3b => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:48:49 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:49 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:49 user devstack@n-api.service[61674]: DEBUG nova.objects.instance [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lazy-loading 'services' on Instance uuid e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 {{(pid=61674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 18:48:49 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/os-volume_attachments/786535d2-c800-442a-bc6d-c788f7b28bdf" status: 202 len: 0 microversion: 2.49 time: 0.165636 Apr 14 18:48:49 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 63/185] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 18:48:49 2023] DELETE /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/os-volume_attachments/786535d2-c800-442a-bc6d-c788f7b28bdf => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 18:48:50 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-ffb4f44e-23ec-4762-bb51-a6d17a19be7f tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:50 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-ffb4f44e-23ec-4762-bb51-a6d17a19be7f tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ffb4f44e-23ec-4762-bb51-a6d17a19be7f tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ffb4f44e-23ec-4762-bb51-a6d17a19be7f tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ffb4f44e-23ec-4762-bb51-a6d17a19be7f tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ffb4f44e-23ec-4762-bb51-a6d17a19be7f tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ffb4f44e-23ec-4762-bb51-a6d17a19be7f tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ffb4f44e-23ec-4762-bb51-a6d17a19be7f tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:51 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-ffb4f44e-23ec-4762-bb51-a6d17a19be7f tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3378ec4-364a-4656-ac99-500be9d40749/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.436993 Apr 14 18:48:51 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 64/186] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 18:48:50 2023] GET /compute/v2.1/servers/a3378ec4-364a-4656-ac99-500be9d40749/os-interface => generated 1830 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:48:52 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:52 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:52 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:52 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:52 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:52 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:52 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:52 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:52 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/os-interface/29934039-40ef-4f75-a712-55b7ab72c0b0" status: 202 len: 0 microversion: 2.49 time: 0.092037 Apr 14 18:48:52 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 60/187] 10.0.0.210 () {64 vars in 1507 bytes} [Fri Apr 14 18:48:52 2023] DELETE /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/os-interface/29934039-40ef-4f75-a712-55b7ab72c0b0 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 18:48:52 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-b1d4a18d-e7d0-4fb4-8070-bae5a4e1bc0b tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:52 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-b1d4a18d-e7d0-4fb4-8070-bae5a4e1bc0b tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:52 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b1d4a18d-e7d0-4fb4-8070-bae5a4e1bc0b tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:52 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b1d4a18d-e7d0-4fb4-8070-bae5a4e1bc0b tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:52 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b1d4a18d-e7d0-4fb4-8070-bae5a4e1bc0b tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:52 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b1d4a18d-e7d0-4fb4-8070-bae5a4e1bc0b tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:52 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b1d4a18d-e7d0-4fb4-8070-bae5a4e1bc0b tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:52 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b1d4a18d-e7d0-4fb4-8070-bae5a4e1bc0b tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:52 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:48:52 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-b1d4a18d-e7d0-4fb4-8070-bae5a4e1bc0b tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/os-instance-actions/req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd" status: 200 len: 474 microversion: 2.49 time: 0.256472 Apr 14 18:48:52 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 64/188] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 18:48:52 2023] GET /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/os-instance-actions/req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd => generated 474 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 18:48:52 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-ad703a5c-c00c-49f0-9c70-b28aab6db041 req-79ced371-04b8-44df-91c5-b658ae120b9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "tag": "6690e4a9-1979-4050-a6cc-b8fb4c413d24"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:52 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-ad703a5c-c00c-49f0-9c70-b28aab6db041 req-79ced371-04b8-44df-91c5-b658ae120b9c service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:52 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-ad703a5c-c00c-49f0-9c70-b28aab6db041 req-79ced371-04b8-44df-91c5-b658ae120b9c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:52 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-ad703a5c-c00c-49f0-9c70-b28aab6db041 req-79ced371-04b8-44df-91c5-b658ae120b9c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:52 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-2607d717-0e99-4c28-b890-7322ae47a58a tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:52 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-2607d717-0e99-4c28-b890-7322ae47a58a tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:52 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-ad703a5c-c00c-49f0-9c70-b28aab6db041 req-79ced371-04b8-44df-91c5-b658ae120b9c service nova] Creating event network-changed:6690e4a9-1979-4050-a6cc-b8fb4c413d24 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:48:52 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2607d717-0e99-4c28-b890-7322ae47a58a tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:52 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-ad703a5c-c00c-49f0-9c70-b28aab6db041 req-79ced371-04b8-44df-91c5-b658ae120b9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031538 Apr 14 18:48:52 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2607d717-0e99-4c28-b890-7322ae47a58a tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:52 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 65/189] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:48:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:52 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2607d717-0e99-4c28-b890-7322ae47a58a tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:52 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2607d717-0e99-4c28-b890-7322ae47a58a tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:52 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2607d717-0e99-4c28-b890-7322ae47a58a tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:52 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2607d717-0e99-4c28-b890-7322ae47a58a tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:53 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-2607d717-0e99-4c28-b890-7322ae47a58a tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4dc36f0048042929d1230f99e2be306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ec916e861d448a853251f522699446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:48:53 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-2607d717-0e99-4c28-b890-7322ae47a58a tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4dc36f0048042929d1230f99e2be306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ec916e861d448a853251f522699446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:48:53 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-2607d717-0e99-4c28-b890-7322ae47a58a tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4dc36f0048042929d1230f99e2be306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ec916e861d448a853251f522699446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:48:53 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-2607d717-0e99-4c28-b890-7322ae47a58a tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3378ec4-364a-4656-ac99-500be9d40749" status: 200 len: 2826 microversion: 2.32 time: 0.448740 Apr 14 18:48:53 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 61/190] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:48:52 2023] GET /compute/v2.1/servers/a3378ec4-364a-4656-ac99-500be9d40749 => generated 2826 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:48:53 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-9d679c8a-f95b-4c20-a7b5-dab01fc70993 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:53 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-9d679c8a-f95b-4c20-a7b5-dab01fc70993 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:53 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-9d679c8a-f95b-4c20-a7b5-dab01fc70993 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:53 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-9d679c8a-f95b-4c20-a7b5-dab01fc70993 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:53 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-9d679c8a-f95b-4c20-a7b5-dab01fc70993 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:53 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-9d679c8a-f95b-4c20-a7b5-dab01fc70993 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:53 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-9d679c8a-f95b-4c20-a7b5-dab01fc70993 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:53 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-9d679c8a-f95b-4c20-a7b5-dab01fc70993 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:53 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-9d679c8a-f95b-4c20-a7b5-dab01fc70993 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3378ec4-364a-4656-ac99-500be9d40749/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.150671 Apr 14 18:48:53 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 65/191] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 18:48:53 2023] GET /compute/v2.1/servers/a3378ec4-364a-4656-ac99-500be9d40749/os-interface => generated 1830 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:48:54 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:54 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:54 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:54 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:54 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:54 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:54 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:54 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:54 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Going to try to terminate instance {{(pid=61675) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 18:48:54 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a3378ec4-364a-4656-ac99-500be9d40749" status: 204 len: 0 microversion: 2.32 time: 0.132825 Apr 14 18:48:54 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 66/192] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 18:48:54 2023] DELETE /compute/v2.1/servers/a3378ec4-364a-4656-ac99-500be9d40749 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 18:48:54 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-ebd20477-3d38-4df8-b588-42b0ccb6b8d2 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:54 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-ebd20477-3d38-4df8-b588-42b0ccb6b8d2 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:54 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ebd20477-3d38-4df8-b588-42b0ccb6b8d2 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:54 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ebd20477-3d38-4df8-b588-42b0ccb6b8d2 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:54 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ebd20477-3d38-4df8-b588-42b0ccb6b8d2 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:54 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ebd20477-3d38-4df8-b588-42b0ccb6b8d2 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:54 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ebd20477-3d38-4df8-b588-42b0ccb6b8d2 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:54 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ebd20477-3d38-4df8-b588-42b0ccb6b8d2 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:54 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-683c90a1-dfe6-41eb-b586-1590b0ef9a0f tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Calling method '.version_select at 0x7fdae1321bd0>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:54 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-683c90a1-dfe6-41eb-b586-1590b0ef9a0f tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 10.0.0.210 "GET /compute/v2.1/images/6e8245ec-8367-4bce-99df-352eae7f4ed7" status: 200 len: 1723 microversion: 2.1 time: 0.064780 Apr 14 18:48:54 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 66/193] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 18:48:54 2023] GET /compute/v2.1/images/6e8245ec-8367-4bce-99df-352eae7f4ed7 => generated 1723 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:48:54 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-1c662ccb-72cc-4e3b-9838-922f60e81f94 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Calling method '.version_select at 0x7fdae1526170>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:54 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-ebd20477-3d38-4df8-b588-42b0ccb6b8d2 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4dc36f0048042929d1230f99e2be306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ec916e861d448a853251f522699446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:48:54 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-ebd20477-3d38-4df8-b588-42b0ccb6b8d2 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4dc36f0048042929d1230f99e2be306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ec916e861d448a853251f522699446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:48:54 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-ebd20477-3d38-4df8-b588-42b0ccb6b8d2 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4dc36f0048042929d1230f99e2be306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ec916e861d448a853251f522699446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:48:54 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-ebd20477-3d38-4df8-b588-42b0ccb6b8d2 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3378ec4-364a-4656-ac99-500be9d40749" status: 200 len: 2951 microversion: 2.32 time: 0.258297 Apr 14 18:48:54 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 62/194] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:48:54 2023] GET /compute/v2.1/servers/a3378ec4-364a-4656-ac99-500be9d40749 => generated 2951 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:48:54 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-6ec14b1f-48b2-4d38-b42c-1958689e4982 req-f5504a5e-d56c-4aa7-9836-959d9fc73f71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-unplugged", "status": "completed", "tag": "6690e4a9-1979-4050-a6cc-b8fb4c413d24"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:54 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-1c662ccb-72cc-4e3b-9838-922f60e81f94 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 10.0.0.210 "GET /compute/v2.1/images/6e8245ec-8367-4bce-99df-352eae7f4ed7" status: 200 len: 1723 microversion: 2.1 time: 0.062918 Apr 14 18:48:54 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 67/195] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 18:48:54 2023] GET /compute/v2.1/images/6e8245ec-8367-4bce-99df-352eae7f4ed7 => generated 1723 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:48:54 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6ec14b1f-48b2-4d38-b42c-1958689e4982 req-f5504a5e-d56c-4aa7-9836-959d9fc73f71 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:54 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6ec14b1f-48b2-4d38-b42c-1958689e4982 req-f5504a5e-d56c-4aa7-9836-959d9fc73f71 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:54 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6ec14b1f-48b2-4d38-b42c-1958689e4982 req-f5504a5e-d56c-4aa7-9836-959d9fc73f71 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:54 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-f3c19df5-04d7-42ce-a850-c42a47ba7a33 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:54 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-f3c19df5-04d7-42ce-a850-c42a47ba7a33 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:54 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-43e2689d-4082-499f-99b4-4f423e335d39 req-03c7ee2e-c786-4c02-a366-b4b0bb83b4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99", "name": "network-vif-unplugged", "status": "completed", "tag": "29934039-40ef-4f75-a712-55b7ab72c0b0"}, {"server_uuid": "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99", "name": "network-vif-plugged", "status": "completed", "tag": "29934039-40ef-4f75-a712-55b7ab72c0b0"}, {"server_uuid": "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99", "name": "network-vif-deleted", "tag": "29934039-40ef-4f75-a712-55b7ab72c0b0"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:54 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f3c19df5-04d7-42ce-a850-c42a47ba7a33 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:54 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f3c19df5-04d7-42ce-a850-c42a47ba7a33 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:54 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f3c19df5-04d7-42ce-a850-c42a47ba7a33 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:54 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f3c19df5-04d7-42ce-a850-c42a47ba7a33 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:54 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f3c19df5-04d7-42ce-a850-c42a47ba7a33 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:54 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f3c19df5-04d7-42ce-a850-c42a47ba7a33 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:54 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-6ec14b1f-48b2-4d38-b42c-1958689e4982 req-f5504a5e-d56c-4aa7-9836-959d9fc73f71 service nova] Creating event network-vif-unplugged:6690e4a9-1979-4050-a6cc-b8fb4c413d24 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:48:54 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-43e2689d-4082-499f-99b4-4f423e335d39 req-03c7ee2e-c786-4c02-a366-b4b0bb83b4c5 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:54 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-43e2689d-4082-499f-99b4-4f423e335d39 req-03c7ee2e-c786-4c02-a366-b4b0bb83b4c5 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:54 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-43e2689d-4082-499f-99b4-4f423e335d39 req-03c7ee2e-c786-4c02-a366-b4b0bb83b4c5 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:54 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-6ec14b1f-48b2-4d38-b42c-1958689e4982 req-f5504a5e-d56c-4aa7-9836-959d9fc73f71 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038278 Apr 14 18:48:54 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 67/196] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:48:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:54 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-43e2689d-4082-499f-99b4-4f423e335d39 req-03c7ee2e-c786-4c02-a366-b4b0bb83b4c5 service nova] Creating event network-vif-unplugged:29934039-40ef-4f75-a712-55b7ab72c0b0 for instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 on user Apr 14 18:48:54 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-43e2689d-4082-499f-99b4-4f423e335d39 req-03c7ee2e-c786-4c02-a366-b4b0bb83b4c5 service nova] Creating event network-vif-plugged:29934039-40ef-4f75-a712-55b7ab72c0b0 for instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 on user Apr 14 18:48:54 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-43e2689d-4082-499f-99b4-4f423e335d39 req-03c7ee2e-c786-4c02-a366-b4b0bb83b4c5 service nova] Creating event network-vif-deleted:29934039-40ef-4f75-a712-55b7ab72c0b0 for instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 on user Apr 14 18:48:54 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-43e2689d-4082-499f-99b4-4f423e335d39 req-03c7ee2e-c786-4c02-a366-b4b0bb83b4c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.035104 Apr 14 18:48:54 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 68/197] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:48:54 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:55 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-f3c19df5-04d7-42ce-a850-c42a47ba7a33 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ed7885e7774691b02c19cf08c2177f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d84c59848f445a90eb7eab6be04253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:48:55 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-f3c19df5-04d7-42ce-a850-c42a47ba7a33 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c" status: 200 len: 1673 microversion: 2.1 time: 0.352337 Apr 14 18:48:55 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 63/198] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:48:54 2023] GET /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c => generated 1673 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:48:55 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-2d63864b-b114-4f9e-90d2-bda250c1806a req-46a508c3-d091-40ab-8625-aa087319aec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-unplugged", "status": "completed", "tag": "3e05363d-18d0-4fb0-9c3e-40df44246913"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:55 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-2d63864b-b114-4f9e-90d2-bda250c1806a req-46a508c3-d091-40ab-8625-aa087319aec2 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:55 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-2d63864b-b114-4f9e-90d2-bda250c1806a req-46a508c3-d091-40ab-8625-aa087319aec2 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:55 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-2d63864b-b114-4f9e-90d2-bda250c1806a req-46a508c3-d091-40ab-8625-aa087319aec2 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:55 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-2d63864b-b114-4f9e-90d2-bda250c1806a req-46a508c3-d091-40ab-8625-aa087319aec2 service nova] Creating event network-vif-unplugged:3e05363d-18d0-4fb0-9c3e-40df44246913 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:48:55 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-2d63864b-b114-4f9e-90d2-bda250c1806a req-46a508c3-d091-40ab-8625-aa087319aec2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069994 Apr 14 18:48:55 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 68/199] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:48:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:56 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-41369d5d-c5ab-4ada-a20a-016bb0a34d26 req-85eb58cd-f7e7-4b0f-acff-a0ab51e3e305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-plugged", "status": "completed", "tag": "6690e4a9-1979-4050-a6cc-b8fb4c413d24"}, {"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-unplugged", "status": "completed", "tag": "d30907fa-2785-4ffe-8552-7221fbff7200"}, {"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-plugged", "status": "completed", "tag": "d30907fa-2785-4ffe-8552-7221fbff7200"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:56 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-41369d5d-c5ab-4ada-a20a-016bb0a34d26 req-85eb58cd-f7e7-4b0f-acff-a0ab51e3e305 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:56 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-41369d5d-c5ab-4ada-a20a-016bb0a34d26 req-85eb58cd-f7e7-4b0f-acff-a0ab51e3e305 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:56 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-41369d5d-c5ab-4ada-a20a-016bb0a34d26 req-85eb58cd-f7e7-4b0f-acff-a0ab51e3e305 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:56 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-41369d5d-c5ab-4ada-a20a-016bb0a34d26 req-85eb58cd-f7e7-4b0f-acff-a0ab51e3e305 service nova] Creating event network-vif-plugged:6690e4a9-1979-4050-a6cc-b8fb4c413d24 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:48:56 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-41369d5d-c5ab-4ada-a20a-016bb0a34d26 req-85eb58cd-f7e7-4b0f-acff-a0ab51e3e305 service nova] Creating event network-vif-unplugged:d30907fa-2785-4ffe-8552-7221fbff7200 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:48:57 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-41369d5d-c5ab-4ada-a20a-016bb0a34d26 req-85eb58cd-f7e7-4b0f-acff-a0ab51e3e305 service nova] Creating event network-vif-plugged:d30907fa-2785-4ffe-8552-7221fbff7200 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:48:57 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-41369d5d-c5ab-4ada-a20a-016bb0a34d26 req-85eb58cd-f7e7-4b0f-acff-a0ab51e3e305 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.034448 Apr 14 18:48:57 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-unplugged", "status": "completed", "tag": "83687b87-4245-4c8f-9a7e-d18dd00942d3"}, {"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-plugged", "status": "completed", "tag": "83687b87-4245-4c8f-9a7e-d18dd00942d3"}, {"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-unplugged", "status": "completed", "tag": "1e979f27-58d7-4973-b70d-f3ca1c5811c5"}, {"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-plugged", "status": "completed", "tag": "1e979f27-58d7-4973-b70d-f3ca1c5811c5"}, {"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-unplugged", "status": "completed", "tag": "b24d8534-70cf-4575-a8f1-f99b5e48b7db"}, {"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-plugged", "status": "completed", "tag": "b24d8534-70cf-4575-a8f1-f99b5e48b7db"}, {"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-unplugged", "status": "completed", "tag": "85e8f915-2217-47d4-a9a8-74be630b2b10"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:57 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 69/200] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:48:56 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:57 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=24 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:48:57 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:57 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:57 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:57 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=3 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:48:57 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Creating event network-vif-unplugged:83687b87-4245-4c8f-9a7e-d18dd00942d3 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:48:57 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Creating event network-vif-plugged:83687b87-4245-4c8f-9a7e-d18dd00942d3 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:48:57 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Creating event network-vif-unplugged:1e979f27-58d7-4973-b70d-f3ca1c5811c5 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:48:57 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Creating event network-vif-plugged:1e979f27-58d7-4973-b70d-f3ca1c5811c5 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:48:57 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Creating event network-vif-unplugged:b24d8534-70cf-4575-a8f1-f99b5e48b7db for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:48:57 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Creating event network-vif-plugged:b24d8534-70cf-4575-a8f1-f99b5e48b7db for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:48:57 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Creating event network-vif-unplugged:85e8f915-2217-47d4-a9a8-74be630b2b10 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:48:57 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1217 microversion: 2.1 time: 0.053129 Apr 14 18:48:57 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 64/201] 10.0.0.210 () {68 vars in 1395 bytes} [Fri Apr 14 18:48:57 2023] POST /compute/v2.1/os-server-external-events => generated 1217 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:48:57 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-b1a90199-fcbd-4f70-af35-ccd0769f738c req-0821731c-f3af-4ea4-84b5-a75304ece7a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-plugged", "status": "completed", "tag": "3e05363d-18d0-4fb0-9c3e-40df44246913"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:57 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-b1a90199-fcbd-4f70-af35-ccd0769f738c req-0821731c-f3af-4ea4-84b5-a75304ece7a3 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:57 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-b1a90199-fcbd-4f70-af35-ccd0769f738c req-0821731c-f3af-4ea4-84b5-a75304ece7a3 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:57 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-b1a90199-fcbd-4f70-af35-ccd0769f738c req-0821731c-f3af-4ea4-84b5-a75304ece7a3 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:57 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-b1a90199-fcbd-4f70-af35-ccd0769f738c req-0821731c-f3af-4ea4-84b5-a75304ece7a3 service nova] Creating event network-vif-plugged:3e05363d-18d0-4fb0-9c3e-40df44246913 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:48:57 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-b1a90199-fcbd-4f70-af35-ccd0769f738c req-0821731c-f3af-4ea4-84b5-a75304ece7a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056446 Apr 14 18:48:57 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 69/202] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:48:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:58 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-3721a9fb-42a6-497c-9b82-5b728510909e tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:58 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-3721a9fb-42a6-497c-9b82-5b728510909e tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3721a9fb-42a6-497c-9b82-5b728510909e tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3721a9fb-42a6-497c-9b82-5b728510909e tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3721a9fb-42a6-497c-9b82-5b728510909e tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3721a9fb-42a6-497c-9b82-5b728510909e tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3721a9fb-42a6-497c-9b82-5b728510909e tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3721a9fb-42a6-497c-9b82-5b728510909e tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:58 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-3721a9fb-42a6-497c-9b82-5b728510909e tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] HTTP exception thrown: Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 could not be found. Apr 14 18:48:58 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-3721a9fb-42a6-497c-9b82-5b728510909e tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Request method failure captured: Apr 14 18:48:58 user devstack@n-api.service[61675]: request: GET /compute/v2.1/servers/849b47d6-c267-420e-bb09-e43e33ad1df1 HTTP/1.1 Apr 14 18:48:58 user devstack@n-api.service[61675]: Accept: application/json Apr 14 18:48:58 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 18:48:58 user devstack@n-api.service[61675]: Connection: close Apr 14 18:48:58 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 18:48:58 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 18:48:58 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 18:48:58 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 18:48:58 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 18:48:58 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOZ9rmSsydwyWWIYwTWcFbHhplQEg8Cc4_7ZHu1ippXc2KMWj6TiiIg7CvHPS-nVUPuwTZSwpx4-20LiB5BiF_3qdpaRyay8tP8Kd7HYZlaAIX1lKTO08ZM0rC_UVRtbR17C0iccWdrzCy4G_G7W9xiJK8aqx-XECSzHvbSAXUVLeb1s Apr 14 18:48:58 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 18:48:58 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 18:48:58 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 18:48:58 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 18:48:58 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 18:48:58 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 18:48:58 user devstack@n-api.service[61675]: X-Project-Id: 04f259dc787d468596879969e33f2e62 Apr 14 18:48:58 user devstack@n-api.service[61675]: X-Project-Name: tempest-DeleteServersTestJSON-1432237973 Apr 14 18:48:58 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 18:48:58 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 18:48:58 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/04f259dc787d468596879969e33f2e62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/04f259dc787d468596879969e33f2e62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/04f259dc787d468596879969e33f2e62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:48:58 user devstack@n-api.service[61675]: X-Tenant: tempest-DeleteServersTestJSON-1432237973 Apr 14 18:48:58 user devstack@n-api.service[61675]: X-Tenant-Id: 04f259dc787d468596879969e33f2e62 Apr 14 18:48:58 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-DeleteServersTestJSON-1432237973 Apr 14 18:48:58 user devstack@n-api.service[61675]: X-User: tempest-DeleteServersTestJSON-1432237973-project-member Apr 14 18:48:58 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 18:48:58 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 18:48:58 user devstack@n-api.service[61675]: X-User-Id: 3a860138cfc74444a78dc1e456a9d67f Apr 14 18:48:58 user devstack@n-api.service[61675]: X-User-Name: tempest-DeleteServersTestJSON-1432237973-project-member Apr 14 18:48:58 user devstack@n-api.service[61675]: method: > Apr 14 18:48:58 user devstack@n-api.service[61675]: exception: Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 could not be found. Apr 14 18:48:58 user devstack@n-api.service[61675]: action_args: {'id': '849b47d6-c267-420e-bb09-e43e33ad1df1'} Apr 14 18:48:58 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 could not be found. Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 could not be found. Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 could not be found. Apr 14 18:48:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:48:58 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-3721a9fb-42a6-497c-9b82-5b728510909e tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Returning 404 to user: Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:48:58 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-3721a9fb-42a6-497c-9b82-5b728510909e tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] 10.0.0.210 "GET /compute/v2.1/servers/849b47d6-c267-420e-bb09-e43e33ad1df1" status: 404 len: 111 microversion: 2.1 time: 0.042180 Apr 14 18:48:58 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 70/203] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:48:58 2023] GET /compute/v2.1/servers/849b47d6-c267-420e-bb09-e43e33ad1df1 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:48:58 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-8c4e9313-7679-4132-ab2e-a69cdfdcc4aa tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:48:58 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-8c4e9313-7679-4132-ab2e-a69cdfdcc4aa tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:48:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8c4e9313-7679-4132-ab2e-a69cdfdcc4aa tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8c4e9313-7679-4132-ab2e-a69cdfdcc4aa tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8c4e9313-7679-4132-ab2e-a69cdfdcc4aa tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8c4e9313-7679-4132-ab2e-a69cdfdcc4aa tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8c4e9313-7679-4132-ab2e-a69cdfdcc4aa tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8c4e9313-7679-4132-ab2e-a69cdfdcc4aa tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:58 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-8c4e9313-7679-4132-ab2e-a69cdfdcc4aa tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] HTTP exception thrown: Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 could not be found. Apr 14 18:48:58 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-8c4e9313-7679-4132-ab2e-a69cdfdcc4aa tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Request method failure captured: Apr 14 18:48:58 user devstack@n-api.service[61673]: request: GET /compute/v2.1/servers/849b47d6-c267-420e-bb09-e43e33ad1df1/os-volume_attachments HTTP/1.1 Apr 14 18:48:58 user devstack@n-api.service[61673]: Accept: application/json Apr 14 18:48:58 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 18:48:58 user devstack@n-api.service[61673]: Connection: close Apr 14 18:48:58 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 18:48:58 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 18:48:58 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 18:48:58 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 18:48:58 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 18:48:58 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOZ9rmSsydwyWWIYwTWcFbHhplQEg8Cc4_7ZHu1ippXc2KMWj6TiiIg7CvHPS-nVUPuwTZSwpx4-20LiB5BiF_3qdpaRyay8tP8Kd7HYZlaAIX1lKTO08ZM0rC_UVRtbR17C0iccWdrzCy4G_G7W9xiJK8aqx-XECSzHvbSAXUVLeb1s Apr 14 18:48:58 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 18:48:58 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 18:48:58 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 18:48:58 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 18:48:58 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 18:48:58 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 18:48:58 user devstack@n-api.service[61673]: X-Project-Id: 04f259dc787d468596879969e33f2e62 Apr 14 18:48:58 user devstack@n-api.service[61673]: X-Project-Name: tempest-DeleteServersTestJSON-1432237973 Apr 14 18:48:58 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 18:48:58 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 18:48:58 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/04f259dc787d468596879969e33f2e62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/04f259dc787d468596879969e33f2e62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/04f259dc787d468596879969e33f2e62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:48:58 user devstack@n-api.service[61673]: X-Tenant: tempest-DeleteServersTestJSON-1432237973 Apr 14 18:48:58 user devstack@n-api.service[61673]: X-Tenant-Id: 04f259dc787d468596879969e33f2e62 Apr 14 18:48:58 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-DeleteServersTestJSON-1432237973 Apr 14 18:48:58 user devstack@n-api.service[61673]: X-User: tempest-DeleteServersTestJSON-1432237973-project-member Apr 14 18:48:58 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 18:48:58 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 18:48:58 user devstack@n-api.service[61673]: X-User-Id: 3a860138cfc74444a78dc1e456a9d67f Apr 14 18:48:58 user devstack@n-api.service[61673]: X-User-Name: tempest-DeleteServersTestJSON-1432237973-project-member Apr 14 18:48:58 user devstack@n-api.service[61673]: method: > Apr 14 18:48:58 user devstack@n-api.service[61673]: exception: Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 could not be found. Apr 14 18:48:58 user devstack@n-api.service[61673]: action_args: {'server_id': '849b47d6-c267-420e-bb09-e43e33ad1df1'} Apr 14 18:48:58 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 could not be found. Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 could not be found. Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 could not be found. Apr 14 18:48:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:48:58 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-8c4e9313-7679-4132-ab2e-a69cdfdcc4aa tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Returning 404 to user: Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:48:58 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-8c4e9313-7679-4132-ab2e-a69cdfdcc4aa tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] 10.0.0.210 "GET /compute/v2.1/servers/849b47d6-c267-420e-bb09-e43e33ad1df1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046268 Apr 14 18:48:58 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 65/204] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:48:58 2023] GET /compute/v2.1/servers/849b47d6-c267-420e-bb09-e43e33ad1df1/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 18:48:59 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-b9464600-9fb4-4c82-afb6-743968e01ba1 req-7b18b368-d864-4a01-8d6f-ef0e49077a88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-plugged", "status": "completed", "tag": "85e8f915-2217-47d4-a9a8-74be630b2b10"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:59 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=34 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:48:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-b9464600-9fb4-4c82-afb6-743968e01ba1 req-7b18b368-d864-4a01-8d6f-ef0e49077a88 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:48:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-b9464600-9fb4-4c82-afb6-743968e01ba1 req-7b18b368-d864-4a01-8d6f-ef0e49077a88 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:48:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-b9464600-9fb4-4c82-afb6-743968e01ba1 req-7b18b368-d864-4a01-8d6f-ef0e49077a88 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:48:59 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-b9464600-9fb4-4c82-afb6-743968e01ba1 req-7b18b368-d864-4a01-8d6f-ef0e49077a88 service nova] Creating event network-vif-plugged:85e8f915-2217-47d4-a9a8-74be630b2b10 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:48:59 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-b9464600-9fb4-4c82-afb6-743968e01ba1 req-7b18b368-d864-4a01-8d6f-ef0e49077a88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039206 Apr 14 18:48:59 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 70/205] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:48:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:48:59 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1219397521", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "a4933fe8-a8cc-498f-925f-185cdae2f1f7"}]}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:48:59 user devstack@n-api.service[61675]: DEBUG nova.network.neutron [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] validate_networks() for [('a4933fe8-a8cc-498f-925f-185cdae2f1f7', None, None, None, None, None)] {{(pid=61675) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:49:00 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Flavor limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:49:00 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Image limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:49:00 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Flavor pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:49:00 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Image pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:49:00 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:49:00 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:00 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:00 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:00 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:00 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:00 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:00 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=8,nova_cell1:INSERT=5 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:49:00 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:49:00 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Getting quotas for project 424e732759884efa8fd126cd9a082c8a. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:49:00 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Getting quotas for user a644b8bb9b90494ba670da8315bfe005 and project 424e732759884efa8fd126cd9a082c8a. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:49:00 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Going to run 1 instances... {{(pid=61675) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:49:00 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:49:00 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.695904 Apr 14 18:49:00 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 71/206] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 18:48:59 2023] POST /compute/v2.1/servers => generated 378 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 18:49:00 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-b08f6595-4f08-4238-91a9-f4722ee79798 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:00 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-b08f6595-4f08-4238-91a9-f4722ee79798 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:00 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-b08f6595-4f08-4238-91a9-f4722ee79798 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:49:00 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-b08f6595-4f08-4238-91a9-f4722ee79798 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:49:00 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-b08f6595-4f08-4238-91a9-f4722ee79798 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:49:00 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-b08f6595-4f08-4238-91a9-f4722ee79798 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23d14a51-41aa-4827-bd60-c605d9689bc8" status: 200 len: 1395 microversion: 2.87 time: 0.089810 Apr 14 18:49:00 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 66/207] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:49:00 2023] GET /compute/v2.1/servers/23d14a51-41aa-4827-bd60-c605d9689bc8 => generated 1395 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:49:01 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-4889b6ae-15d4-4de7-a41c-7a0a0893f3e8 req-c1f0352d-a3b8-48e9-8313-3f7dda694aef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-deleted", "tag": "1e979f27-58d7-4973-b70d-f3ca1c5811c5"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-4889b6ae-15d4-4de7-a41c-7a0a0893f3e8 req-c1f0352d-a3b8-48e9-8313-3f7dda694aef service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-4889b6ae-15d4-4de7-a41c-7a0a0893f3e8 req-c1f0352d-a3b8-48e9-8313-3f7dda694aef service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-4889b6ae-15d4-4de7-a41c-7a0a0893f3e8 req-c1f0352d-a3b8-48e9-8313-3f7dda694aef service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:01 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-4889b6ae-15d4-4de7-a41c-7a0a0893f3e8 req-c1f0352d-a3b8-48e9-8313-3f7dda694aef service nova] Creating event network-vif-deleted:1e979f27-58d7-4973-b70d-f3ca1c5811c5 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:49:01 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-4889b6ae-15d4-4de7-a41c-7a0a0893f3e8 req-c1f0352d-a3b8-48e9-8313-3f7dda694aef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038342 Apr 14 18:49:01 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 71/208] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:49:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:01 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-fad98083-684b-4bd0-8145-a49f694cea19 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:01 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-fad98083-684b-4bd0-8145-a49f694cea19 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fad98083-684b-4bd0-8145-a49f694cea19 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fad98083-684b-4bd0-8145-a49f694cea19 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fad98083-684b-4bd0-8145-a49f694cea19 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fad98083-684b-4bd0-8145-a49f694cea19 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fad98083-684b-4bd0-8145-a49f694cea19 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fad98083-684b-4bd0-8145-a49f694cea19 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:01 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-ef3460c9-429b-41f5-b683-ff19e23cb7b9 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:01 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-ef3460c9-429b-41f5-b683-ff19e23cb7b9 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ef3460c9-429b-41f5-b683-ff19e23cb7b9 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ef3460c9-429b-41f5-b683-ff19e23cb7b9 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ef3460c9-429b-41f5-b683-ff19e23cb7b9 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ef3460c9-429b-41f5-b683-ff19e23cb7b9 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ef3460c9-429b-41f5-b683-ff19e23cb7b9 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ef3460c9-429b-41f5-b683-ff19e23cb7b9 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:01 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-ef3460c9-429b-41f5-b683-ff19e23cb7b9 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062479 Apr 14 18:49:01 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 67/209] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:49:01 2023] GET /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:01 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-03419a8d-7705-4447-8f86-3e2135561482 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:01 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-03419a8d-7705-4447-8f86-3e2135561482 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-03419a8d-7705-4447-8f86-3e2135561482 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-03419a8d-7705-4447-8f86-3e2135561482 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-03419a8d-7705-4447-8f86-3e2135561482 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-03419a8d-7705-4447-8f86-3e2135561482 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-03419a8d-7705-4447-8f86-3e2135561482 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-03419a8d-7705-4447-8f86-3e2135561482 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:02 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-fad98083-684b-4bd0-8145-a49f694cea19 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e1d31c2d9048699758779dedf7d3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6b4e98cf9e4f96b79c3288dfe0da89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:49:02 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-fad98083-684b-4bd0-8145-a49f694cea19 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae" status: 200 len: 1536 microversion: 2.1 time: 0.268882 Apr 14 18:49:02 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 72/210] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:49:01 2023] GET /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae => generated 1536 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:49:02 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-6316243b-e896-4ffe-8510-e791e3986290 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:02 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-03419a8d-7705-4447-8f86-3e2135561482 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109920 Apr 14 18:49:02 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 72/211] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:49:01 2023] GET /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:02 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-6316243b-e896-4ffe-8510-e791e3986290 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67e1d31c2d9048699758779dedf7d3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6b4e98cf9e4f96b79c3288dfe0da89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:49:02 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-6316243b-e896-4ffe-8510-e791e3986290 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Searching by: {'deleted': False, 'project_id': '8e6b4e98cf9e4f96b79c3288dfe0da89'} {{(pid=61673) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 14 18:49:02 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "ba2fc051-881a-4012-af7c-22007cc56d3b"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6316243b-e896-4ffe-8510-e791e3986290 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6316243b-e896-4ffe-8510-e791e3986290 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6316243b-e896-4ffe-8510-e791e3986290 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:02 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6316243b-e896-4ffe-8510-e791e3986290 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6316243b-e896-4ffe-8510-e791e3986290 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6316243b-e896-4ffe-8510-e791e3986290 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:02 user devstack@n-api.service[61673]: DEBUG nova.compute.multi_cell_list [None req-6316243b-e896-4ffe-8510-e791e3986290 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61673) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 14 18:49:02 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-6316243b-e896-4ffe-8510-e791e3986290 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.216469 Apr 14 18:49:02 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 68/212] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 14 18:49:02 2023] GET /compute/v2.1/servers => generated 341 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:02 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-2b13be63-db1a-4991-b16f-1ec3e245d062 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:02 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-2b13be63-db1a-4991-b16f-1ec3e245d062 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:02 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-2b13be63-db1a-4991-b16f-1ec3e245d062 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:02 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-2b13be63-db1a-4991-b16f-1ec3e245d062 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:02 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-2b13be63-db1a-4991-b16f-1ec3e245d062 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:02 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-2b13be63-db1a-4991-b16f-1ec3e245d062 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:02 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-2b13be63-db1a-4991-b16f-1ec3e245d062 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:02 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-2b13be63-db1a-4991-b16f-1ec3e245d062 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:02 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6/os-volume_attachments/7646c367-81d4-43cd-bb7a-97ecdd4f9576" status: 202 len: 0 microversion: 2.1 time: 0.332064 Apr 14 18:49:02 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 73/213] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 18:49:02 2023] PUT /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6/os-volume_attachments/7646c367-81d4-43cd-bb7a-97ecdd4f9576 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:49:02 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-2b13be63-db1a-4991-b16f-1ec3e245d062 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e1d31c2d9048699758779dedf7d3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6b4e98cf9e4f96b79c3288dfe0da89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:49:02 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-2b13be63-db1a-4991-b16f-1ec3e245d062 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae" status: 200 len: 1536 microversion: 2.1 time: 0.381989 Apr 14 18:49:02 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 73/214] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:49:02 2023] GET /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae => generated 1536 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 18:49:03 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-2af04671-28b6-44d2-90f2-49b61460c7fd req-43985ec7-58e0-48ce-8f89-c764f97f8941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-deleted", "tag": "3e05363d-18d0-4fb0-9c3e-40df44246913"}, {"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-deleted", "tag": "b24d8534-70cf-4575-a8f1-f99b5e48b7db"}, {"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-deleted", "tag": "85e8f915-2217-47d4-a9a8-74be630b2b10"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:03 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-2af04671-28b6-44d2-90f2-49b61460c7fd req-43985ec7-58e0-48ce-8f89-c764f97f8941 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:03 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-2af04671-28b6-44d2-90f2-49b61460c7fd req-43985ec7-58e0-48ce-8f89-c764f97f8941 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:03 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-2af04671-28b6-44d2-90f2-49b61460c7fd req-43985ec7-58e0-48ce-8f89-c764f97f8941 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:03 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-2af04671-28b6-44d2-90f2-49b61460c7fd req-43985ec7-58e0-48ce-8f89-c764f97f8941 service nova] Creating event network-vif-deleted:3e05363d-18d0-4fb0-9c3e-40df44246913 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:49:03 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-2af04671-28b6-44d2-90f2-49b61460c7fd req-43985ec7-58e0-48ce-8f89-c764f97f8941 service nova] Creating event network-vif-deleted:b24d8534-70cf-4575-a8f1-f99b5e48b7db for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:49:03 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-2af04671-28b6-44d2-90f2-49b61460c7fd req-43985ec7-58e0-48ce-8f89-c764f97f8941 service nova] Creating event network-vif-deleted:85e8f915-2217-47d4-a9a8-74be630b2b10 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:49:03 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-2af04671-28b6-44d2-90f2-49b61460c7fd req-43985ec7-58e0-48ce-8f89-c764f97f8941 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.043881 Apr 14 18:49:03 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 69/215] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:49:03 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:03 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-ab261ed3-02d8-406d-8316-6d048430ab06 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:03 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-ab261ed3-02d8-406d-8316-6d048430ab06 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ab261ed3-02d8-406d-8316-6d048430ab06 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ab261ed3-02d8-406d-8316-6d048430ab06 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ab261ed3-02d8-406d-8316-6d048430ab06 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ab261ed3-02d8-406d-8316-6d048430ab06 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ab261ed3-02d8-406d-8316-6d048430ab06 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ab261ed3-02d8-406d-8316-6d048430ab06 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:03 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-ab261ed3-02d8-406d-8316-6d048430ab06 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] HTTP exception thrown: Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 could not be found. Apr 14 18:49:03 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-ab261ed3-02d8-406d-8316-6d048430ab06 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Request method failure captured: Apr 14 18:49:03 user devstack@n-api.service[61675]: request: DELETE /compute/v2.1/servers/849b47d6-c267-420e-bb09-e43e33ad1df1 HTTP/1.1 Apr 14 18:49:03 user devstack@n-api.service[61675]: Accept: application/json Apr 14 18:49:03 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 18:49:03 user devstack@n-api.service[61675]: Connection: close Apr 14 18:49:03 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 18:49:03 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 18:49:03 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 18:49:03 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 18:49:03 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 18:49:03 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOZ9rmSsydwyWWIYwTWcFbHhplQEg8Cc4_7ZHu1ippXc2KMWj6TiiIg7CvHPS-nVUPuwTZSwpx4-20LiB5BiF_3qdpaRyay8tP8Kd7HYZlaAIX1lKTO08ZM0rC_UVRtbR17C0iccWdrzCy4G_G7W9xiJK8aqx-XECSzHvbSAXUVLeb1s Apr 14 18:49:03 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 18:49:03 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 18:49:03 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 18:49:03 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 18:49:03 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 18:49:03 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 18:49:03 user devstack@n-api.service[61675]: X-Project-Id: 04f259dc787d468596879969e33f2e62 Apr 14 18:49:03 user devstack@n-api.service[61675]: X-Project-Name: tempest-DeleteServersTestJSON-1432237973 Apr 14 18:49:03 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 18:49:03 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 18:49:03 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/04f259dc787d468596879969e33f2e62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/04f259dc787d468596879969e33f2e62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/04f259dc787d468596879969e33f2e62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:49:03 user devstack@n-api.service[61675]: X-Tenant: tempest-DeleteServersTestJSON-1432237973 Apr 14 18:49:03 user devstack@n-api.service[61675]: X-Tenant-Id: 04f259dc787d468596879969e33f2e62 Apr 14 18:49:03 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-DeleteServersTestJSON-1432237973 Apr 14 18:49:03 user devstack@n-api.service[61675]: X-User: tempest-DeleteServersTestJSON-1432237973-project-member Apr 14 18:49:03 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 18:49:03 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 18:49:03 user devstack@n-api.service[61675]: X-User-Id: 3a860138cfc74444a78dc1e456a9d67f Apr 14 18:49:03 user devstack@n-api.service[61675]: X-User-Name: tempest-DeleteServersTestJSON-1432237973-project-member Apr 14 18:49:03 user devstack@n-api.service[61675]: method: > Apr 14 18:49:03 user devstack@n-api.service[61675]: exception: Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 could not be found. Apr 14 18:49:03 user devstack@n-api.service[61675]: action_args: {'id': '849b47d6-c267-420e-bb09-e43e33ad1df1'} Apr 14 18:49:03 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 could not be found. Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 could not be found. Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 could not be found. Apr 14 18:49:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:49:03 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-ab261ed3-02d8-406d-8316-6d048430ab06 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Returning 404 to user: Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:49:03 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-ab261ed3-02d8-406d-8316-6d048430ab06 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/849b47d6-c267-420e-bb09-e43e33ad1df1" status: 404 len: 111 microversion: 2.1 time: 0.039595 Apr 14 18:49:03 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 74/216] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 18:49:03 2023] DELETE /compute/v2.1/servers/849b47d6-c267-420e-bb09-e43e33ad1df1 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:49:03 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-5408484b-3969-4359-96bb-e7ab82a59bf3 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:03 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-5408484b-3969-4359-96bb-e7ab82a59bf3 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:03 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5408484b-3969-4359-96bb-e7ab82a59bf3 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:03 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5408484b-3969-4359-96bb-e7ab82a59bf3 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:03 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5408484b-3969-4359-96bb-e7ab82a59bf3 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:03 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5408484b-3969-4359-96bb-e7ab82a59bf3 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:03 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5408484b-3969-4359-96bb-e7ab82a59bf3 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:03 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5408484b-3969-4359-96bb-e7ab82a59bf3 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:03 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-5408484b-3969-4359-96bb-e7ab82a59bf3 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] HTTP exception thrown: Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 could not be found. Apr 14 18:49:03 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-5408484b-3969-4359-96bb-e7ab82a59bf3 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Request method failure captured: Apr 14 18:49:03 user devstack@n-api.service[61674]: request: GET /compute/v2.1/servers/849b47d6-c267-420e-bb09-e43e33ad1df1 HTTP/1.1 Apr 14 18:49:03 user devstack@n-api.service[61674]: Accept: application/json Apr 14 18:49:03 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 18:49:03 user devstack@n-api.service[61674]: Connection: close Apr 14 18:49:03 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 18:49:03 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 18:49:03 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 18:49:03 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 18:49:03 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 18:49:03 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOZ9rmSsydwyWWIYwTWcFbHhplQEg8Cc4_7ZHu1ippXc2KMWj6TiiIg7CvHPS-nVUPuwTZSwpx4-20LiB5BiF_3qdpaRyay8tP8Kd7HYZlaAIX1lKTO08ZM0rC_UVRtbR17C0iccWdrzCy4G_G7W9xiJK8aqx-XECSzHvbSAXUVLeb1s Apr 14 18:49:03 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 18:49:03 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 18:49:03 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 18:49:03 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 18:49:03 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 18:49:03 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 18:49:03 user devstack@n-api.service[61674]: X-Project-Id: 04f259dc787d468596879969e33f2e62 Apr 14 18:49:03 user devstack@n-api.service[61674]: X-Project-Name: tempest-DeleteServersTestJSON-1432237973 Apr 14 18:49:03 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 18:49:03 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 18:49:03 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/04f259dc787d468596879969e33f2e62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/04f259dc787d468596879969e33f2e62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/04f259dc787d468596879969e33f2e62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:49:03 user devstack@n-api.service[61674]: X-Tenant: tempest-DeleteServersTestJSON-1432237973 Apr 14 18:49:03 user devstack@n-api.service[61674]: X-Tenant-Id: 04f259dc787d468596879969e33f2e62 Apr 14 18:49:03 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-DeleteServersTestJSON-1432237973 Apr 14 18:49:03 user devstack@n-api.service[61674]: X-User: tempest-DeleteServersTestJSON-1432237973-project-member Apr 14 18:49:03 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 18:49:03 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 18:49:03 user devstack@n-api.service[61674]: X-User-Id: 3a860138cfc74444a78dc1e456a9d67f Apr 14 18:49:03 user devstack@n-api.service[61674]: X-User-Name: tempest-DeleteServersTestJSON-1432237973-project-member Apr 14 18:49:03 user devstack@n-api.service[61674]: method: > Apr 14 18:49:03 user devstack@n-api.service[61674]: exception: Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 could not be found. Apr 14 18:49:03 user devstack@n-api.service[61674]: action_args: {'id': '849b47d6-c267-420e-bb09-e43e33ad1df1'} Apr 14 18:49:03 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 could not be found. Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 could not be found. Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 could not be found. Apr 14 18:49:03 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:49:03 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-5408484b-3969-4359-96bb-e7ab82a59bf3 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Returning 404 to user: Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:49:03 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-5408484b-3969-4359-96bb-e7ab82a59bf3 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] 10.0.0.210 "GET /compute/v2.1/servers/849b47d6-c267-420e-bb09-e43e33ad1df1" status: 404 len: 111 microversion: 2.1 time: 0.036110 Apr 14 18:49:03 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 74/217] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:49:03 2023] GET /compute/v2.1/servers/849b47d6-c267-420e-bb09-e43e33ad1df1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:49:03 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-fb3c161a-06d3-431b-b50f-dd97a9d0bd3f req-ea924ac8-8c42-4121-b953-38be1b116a14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23d14a51-41aa-4827-bd60-c605d9689bc8", "tag": "b8044678-899b-4461-bbf0-cf9fd662e71e"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:03 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-fb3c161a-06d3-431b-b50f-dd97a9d0bd3f req-ea924ac8-8c42-4121-b953-38be1b116a14 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:03 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-fb3c161a-06d3-431b-b50f-dd97a9d0bd3f req-ea924ac8-8c42-4121-b953-38be1b116a14 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:03 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-fb3c161a-06d3-431b-b50f-dd97a9d0bd3f req-ea924ac8-8c42-4121-b953-38be1b116a14 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:03 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-fb3c161a-06d3-431b-b50f-dd97a9d0bd3f req-ea924ac8-8c42-4121-b953-38be1b116a14 service nova] Creating event network-changed:b8044678-899b-4461-bbf0-cf9fd662e71e for instance 23d14a51-41aa-4827-bd60-c605d9689bc8 on user Apr 14 18:49:03 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-fb3c161a-06d3-431b-b50f-dd97a9d0bd3f req-ea924ac8-8c42-4121-b953-38be1b116a14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035568 Apr 14 18:49:03 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 70/218] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:49:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:04 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-86f59244-e8d0-467f-aa18-6fe95efb39be tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:04 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-86f59244-e8d0-467f-aa18-6fe95efb39be tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-86f59244-e8d0-467f-aa18-6fe95efb39be tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-86f59244-e8d0-467f-aa18-6fe95efb39be tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-86f59244-e8d0-467f-aa18-6fe95efb39be tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-86f59244-e8d0-467f-aa18-6fe95efb39be tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-86f59244-e8d0-467f-aa18-6fe95efb39be tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-86f59244-e8d0-467f-aa18-6fe95efb39be tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:05 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-9ca19098-b0bf-465e-8324-6c263109fd8c req-6f423059-cb8f-4743-857a-4e1b2cd35a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3378ec4-364a-4656-ac99-500be9d40749", "name": "network-vif-deleted", "tag": "6690e4a9-1979-4050-a6cc-b8fb4c413d24"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:05 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-9ca19098-b0bf-465e-8324-6c263109fd8c req-6f423059-cb8f-4743-857a-4e1b2cd35a26 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:05 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-9ca19098-b0bf-465e-8324-6c263109fd8c req-6f423059-cb8f-4743-857a-4e1b2cd35a26 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:05 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-9ca19098-b0bf-465e-8324-6c263109fd8c req-6f423059-cb8f-4743-857a-4e1b2cd35a26 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:05 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-9ca19098-b0bf-465e-8324-6c263109fd8c req-6f423059-cb8f-4743-857a-4e1b2cd35a26 service nova] Creating event network-vif-deleted:6690e4a9-1979-4050-a6cc-b8fb4c413d24 for instance a3378ec4-364a-4656-ac99-500be9d40749 on user Apr 14 18:49:05 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-9ca19098-b0bf-465e-8324-6c263109fd8c req-6f423059-cb8f-4743-857a-4e1b2cd35a26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057699 Apr 14 18:49:05 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 75/219] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:49:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:05 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-86f59244-e8d0-467f-aa18-6fe95efb39be tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d53edaffb8f4038abd366d7942c6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34cdebcd7154988a957deae140e8eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:49:05 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-86f59244-e8d0-467f-aa18-6fe95efb39be tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9" status: 200 len: 1543 microversion: 2.1 time: 0.748180 Apr 14 18:49:05 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 75/220] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:49:04 2023] GET /compute/v2.1/servers/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 => generated 1543 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:49:06 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31ad3520-e4ab-4564-8a4f-b1f9afc6d344"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:06 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:06 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "POST /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.412606 Apr 14 18:49:06 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 71/221] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 18:49:06 2023] POST /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae/os-volume_attachments => generated 194 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:09 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b5b5249-f5b0-4713-81d6-7593e5705ae1", "device": "/dev/vdb"}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:09 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:10 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2c4f47d7-95da-4a01-b6e6-eb14933fede7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.893523 Apr 14 18:49:10 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 76/222] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 18:49:09 2023] POST /compute/v2.1/servers/2c4f47d7-95da-4a01-b6e6-eb14933fede7/os-volume_attachments => generated 194 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:10 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-545d9e03-efc5-4ac8-84b4-0bee54433ec6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:10 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-545d9e03-efc5-4ac8-84b4-0bee54433ec6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:10 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:49:10 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=6 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:49:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-545d9e03-efc5-4ac8-84b4-0bee54433ec6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-545d9e03-efc5-4ac8-84b4-0bee54433ec6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-545d9e03-efc5-4ac8-84b4-0bee54433ec6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-545d9e03-efc5-4ac8-84b4-0bee54433ec6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-545d9e03-efc5-4ac8-84b4-0bee54433ec6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-545d9e03-efc5-4ac8-84b4-0bee54433ec6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:10 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-545d9e03-efc5-4ac8-84b4-0bee54433ec6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:49:10 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-545d9e03-efc5-4ac8-84b4-0bee54433ec6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 200 len: 1656 microversion: 2.1 time: 0.435002 Apr 14 18:49:10 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 76/223] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:49:10 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 1656 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:49:11 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:49:11 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ced25197-205e-4821-82f2-1f37e41f5993"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:11 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:11 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:11 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:11 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:11 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:11 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:11 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:12 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:49:13 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "POST /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.788877 Apr 14 18:49:13 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 72/224] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 18:49:11 2023] POST /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be/os-volume_attachments => generated 194 bytes in 2792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:15 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-5d4d7f50-d90f-4856-8c1d-beeea8ec3c08 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:15 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-5d4d7f50-d90f-4856-8c1d-beeea8ec3c08 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5d4d7f50-d90f-4856-8c1d-beeea8ec3c08 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5d4d7f50-d90f-4856-8c1d-beeea8ec3c08 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5d4d7f50-d90f-4856-8c1d-beeea8ec3c08 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5d4d7f50-d90f-4856-8c1d-beeea8ec3c08 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5d4d7f50-d90f-4856-8c1d-beeea8ec3c08 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5d4d7f50-d90f-4856-8c1d-beeea8ec3c08 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:15 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-5d4d7f50-d90f-4856-8c1d-beeea8ec3c08 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064344 Apr 14 18:49:15 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 77/225] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:49:15 2023] GET /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:16 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-a67bb827-6ea1-4c57-b11c-97b6f4592ed5 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:16 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-a67bb827-6ea1-4c57-b11c-97b6f4592ed5 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a67bb827-6ea1-4c57-b11c-97b6f4592ed5 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a67bb827-6ea1-4c57-b11c-97b6f4592ed5 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a67bb827-6ea1-4c57-b11c-97b6f4592ed5 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a67bb827-6ea1-4c57-b11c-97b6f4592ed5 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a67bb827-6ea1-4c57-b11c-97b6f4592ed5 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a67bb827-6ea1-4c57-b11c-97b6f4592ed5 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:16 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-a67bb827-6ea1-4c57-b11c-97b6f4592ed5 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040393 Apr 14 18:49:16 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 77/226] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:49:15 2023] GET /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:16 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:16 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:16 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:16 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:16 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:16 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:16 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:16 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:16 user devstack@n-api.service[61673]: DEBUG nova.objects.instance [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lazy-loading 'services' on Instance uuid e03adca9-8b0c-416c-943e-7dce251547c6 {{(pid=61673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 18:49:16 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6/os-volume_attachments/ba2fc051-881a-4012-af7c-22007cc56d3b" status: 202 len: 0 microversion: 2.1 time: 0.381322 Apr 14 18:49:16 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 73/227] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 18:49:16 2023] DELETE /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6/os-volume_attachments/ba2fc051-881a-4012-af7c-22007cc56d3b => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:49:16 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-f0a5f75b-164b-4cfc-a489-b31008bb668c tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:16 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-f0a5f75b-164b-4cfc-a489-b31008bb668c tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f0a5f75b-164b-4cfc-a489-b31008bb668c tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f0a5f75b-164b-4cfc-a489-b31008bb668c tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f0a5f75b-164b-4cfc-a489-b31008bb668c tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f0a5f75b-164b-4cfc-a489-b31008bb668c tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f0a5f75b-164b-4cfc-a489-b31008bb668c tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f0a5f75b-164b-4cfc-a489-b31008bb668c tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:16 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-f0a5f75b-164b-4cfc-a489-b31008bb668c tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071931 Apr 14 18:49:16 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 78/228] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:49:16 2023] GET /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:18 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-60e6a994-92e6-4330-8e7f-3f374d655534 req-192cca24-f63e-42ec-8cc8-b3da2b899b56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d14a51-41aa-4827-bd60-c605d9689bc8", "name": "network-vif-plugged", "status": "completed", "tag": "b8044678-899b-4461-bbf0-cf9fd662e71e"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:18 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-60e6a994-92e6-4330-8e7f-3f374d655534 req-192cca24-f63e-42ec-8cc8-b3da2b899b56 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:18 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-60e6a994-92e6-4330-8e7f-3f374d655534 req-192cca24-f63e-42ec-8cc8-b3da2b899b56 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:18 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-60e6a994-92e6-4330-8e7f-3f374d655534 req-192cca24-f63e-42ec-8cc8-b3da2b899b56 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:18 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-60e6a994-92e6-4330-8e7f-3f374d655534 req-192cca24-f63e-42ec-8cc8-b3da2b899b56 service nova] Creating event network-vif-plugged:b8044678-899b-4461-bbf0-cf9fd662e71e for instance 23d14a51-41aa-4827-bd60-c605d9689bc8 on user Apr 14 18:49:18 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-60e6a994-92e6-4330-8e7f-3f374d655534 req-192cca24-f63e-42ec-8cc8-b3da2b899b56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032209 Apr 14 18:49:18 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 78/229] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:49:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:19 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-cd99325e-0abb-4caa-84bb-a9890ce41c92 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:19 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-cd99325e-0abb-4caa-84bb-a9890ce41c92 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-cd99325e-0abb-4caa-84bb-a9890ce41c92 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-cd99325e-0abb-4caa-84bb-a9890ce41c92 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-cd99325e-0abb-4caa-84bb-a9890ce41c92 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-cd99325e-0abb-4caa-84bb-a9890ce41c92 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-cd99325e-0abb-4caa-84bb-a9890ce41c92 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-cd99325e-0abb-4caa-84bb-a9890ce41c92 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:19 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-cd99325e-0abb-4caa-84bb-a9890ce41c92 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e1d31c2d9048699758779dedf7d3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6b4e98cf9e4f96b79c3288dfe0da89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:49:19 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-cd99325e-0abb-4caa-84bb-a9890ce41c92 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae" status: 200 len: 1582 microversion: 2.1 time: 0.279541 Apr 14 18:49:19 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 74/230] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:49:19 2023] GET /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae => generated 1582 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:49:20 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-652e0506-101e-4b42-ba90-4d325a0a104b req-d17910ce-1240-479a-8178-26f3c95a916b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d14a51-41aa-4827-bd60-c605d9689bc8", "name": "network-vif-plugged", "status": "completed", "tag": "b8044678-899b-4461-bbf0-cf9fd662e71e"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:20 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-652e0506-101e-4b42-ba90-4d325a0a104b req-d17910ce-1240-479a-8178-26f3c95a916b service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:20 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-652e0506-101e-4b42-ba90-4d325a0a104b req-d17910ce-1240-479a-8178-26f3c95a916b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:20 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-652e0506-101e-4b42-ba90-4d325a0a104b req-d17910ce-1240-479a-8178-26f3c95a916b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:20 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-652e0506-101e-4b42-ba90-4d325a0a104b req-d17910ce-1240-479a-8178-26f3c95a916b service nova] Creating event network-vif-plugged:b8044678-899b-4461-bbf0-cf9fd662e71e for instance 23d14a51-41aa-4827-bd60-c605d9689bc8 on user Apr 14 18:49:20 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-652e0506-101e-4b42-ba90-4d325a0a104b req-d17910ce-1240-479a-8178-26f3c95a916b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033755 Apr 14 18:49:20 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 79/231] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:49:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:22 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-7c4b9866-c8b6-4b06-80c5-8c41d5be4ed3 req-7a6ebd0b-dff9-4f6f-883c-ec6a716929fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "656b9f90-ce93-42cd-aa1b-3ff868162aae", "tag": "324b6810-d265-48bc-a2a9-ff7d4759a910"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:22 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-62888a3f-3d9b-4db8-a16f-b510739707ec tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:22 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-62888a3f-3d9b-4db8-a16f-b510739707ec tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-62888a3f-3d9b-4db8-a16f-b510739707ec tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-62888a3f-3d9b-4db8-a16f-b510739707ec tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-62888a3f-3d9b-4db8-a16f-b510739707ec tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-62888a3f-3d9b-4db8-a16f-b510739707ec tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-62888a3f-3d9b-4db8-a16f-b510739707ec tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-7c4b9866-c8b6-4b06-80c5-8c41d5be4ed3 req-7a6ebd0b-dff9-4f6f-883c-ec6a716929fe service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-62888a3f-3d9b-4db8-a16f-b510739707ec tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-7c4b9866-c8b6-4b06-80c5-8c41d5be4ed3 req-7a6ebd0b-dff9-4f6f-883c-ec6a716929fe service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-7c4b9866-c8b6-4b06-80c5-8c41d5be4ed3 req-7a6ebd0b-dff9-4f6f-883c-ec6a716929fe service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:22 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-7c4b9866-c8b6-4b06-80c5-8c41d5be4ed3 req-7a6ebd0b-dff9-4f6f-883c-ec6a716929fe service nova] Creating event network-changed:324b6810-d265-48bc-a2a9-ff7d4759a910 for instance 656b9f90-ce93-42cd-aa1b-3ff868162aae on user Apr 14 18:49:22 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-7c4b9866-c8b6-4b06-80c5-8c41d5be4ed3 req-7a6ebd0b-dff9-4f6f-883c-ec6a716929fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033999 Apr 14 18:49:22 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 75/232] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:49:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:22 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-62888a3f-3d9b-4db8-a16f-b510739707ec tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:49:22 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-62888a3f-3d9b-4db8-a16f-b510739707ec tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 200 len: 1702 microversion: 2.1 time: 0.525090 Apr 14 18:49:22 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 79/233] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:49:22 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 1702 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:49:22 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-1006128169", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:22 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:22 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:22 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:22 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:22 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:22 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:22 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:22 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting quotas for project f028a79640b848228dc6e654a0eef49b. Resources: dict_keys(['metadata_items']) {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:49:22 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting quotas for user 55fa4abe2fdd48cb91f39bf8156a7793 and project f028a79640b848228dc6e654a0eef49b. Resources: dict_keys(['metadata_items']) {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:49:22 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flavor limits 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:49:22 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Image limits 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:49:22 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flavor pref 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:49:22 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Image pref 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:49:22 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:49:23 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:23 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=3,nova_cell1:DELETE=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:49:23 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "POST /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be/action" status: 202 len: 1158 microversion: 2.1 time: 0.398396 Apr 14 18:49:23 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 80/234] 10.0.0.210 () {64 vars in 1356 bytes} [Fri Apr 14 18:49:22 2023] POST /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be/action => generated 1158 bytes in 400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 18:49:23 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-8c8e7cf2-518f-40d6-b5cd-09451ac6cb09 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:23 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-8c8e7cf2-518f-40d6-b5cd-09451ac6cb09 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8c8e7cf2-518f-40d6-b5cd-09451ac6cb09 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8c8e7cf2-518f-40d6-b5cd-09451ac6cb09 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8c8e7cf2-518f-40d6-b5cd-09451ac6cb09 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8c8e7cf2-518f-40d6-b5cd-09451ac6cb09 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8c8e7cf2-518f-40d6-b5cd-09451ac6cb09 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8c8e7cf2-518f-40d6-b5cd-09451ac6cb09 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:23 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-a6340c29-63df-437a-9236-aeab9c7634b4 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1539870350"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:23 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-a6340c29-63df-437a-9236-aeab9c7634b4 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a6340c29-63df-437a-9236-aeab9c7634b4 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a6340c29-63df-437a-9236-aeab9c7634b4 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a6340c29-63df-437a-9236-aeab9c7634b4 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a6340c29-63df-437a-9236-aeab9c7634b4 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a6340c29-63df-437a-9236-aeab9c7634b4 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a6340c29-63df-437a-9236-aeab9c7634b4 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:23 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-8c8e7cf2-518f-40d6-b5cd-09451ac6cb09 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:49:23 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-8c8e7cf2-518f-40d6-b5cd-09451ac6cb09 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 200 len: 1730 microversion: 2.1 time: 0.286740 Apr 14 18:49:23 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 76/235] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:49:23 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 1730 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:49:23 user devstack@n-api.service[61675]: INFO nova.network.security_group_api [None req-a6340c29-63df-437a-9236-aeab9c7634b4 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Adding security group 6763cae2-7915-4d18-8246-14341af2f11f to port 324b6810-d265-48bc-a2a9-ff7d4759a910 Apr 14 18:49:23 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-33d72d24-e5ad-454c-8b76-a158587b6756 req-e4eea238-fcab-4b84-a0e0-a99db2e9cbde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa09363f-435d-4fa8-9f11-db0c3f4e08be", "name": "network-vif-unplugged", "status": "completed", "tag": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-33d72d24-e5ad-454c-8b76-a158587b6756 req-e4eea238-fcab-4b84-a0e0-a99db2e9cbde service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-33d72d24-e5ad-454c-8b76-a158587b6756 req-e4eea238-fcab-4b84-a0e0-a99db2e9cbde service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-33d72d24-e5ad-454c-8b76-a158587b6756 req-e4eea238-fcab-4b84-a0e0-a99db2e9cbde service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:23 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-33d72d24-e5ad-454c-8b76-a158587b6756 req-e4eea238-fcab-4b84-a0e0-a99db2e9cbde service nova] Creating event network-vif-unplugged:2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance aa09363f-435d-4fa8-9f11-db0c3f4e08be on user Apr 14 18:49:23 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-33d72d24-e5ad-454c-8b76-a158587b6756 req-e4eea238-fcab-4b84-a0e0-a99db2e9cbde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054382 Apr 14 18:49:23 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 81/236] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:49:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:24 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-a6340c29-63df-437a-9236-aeab9c7634b4 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "POST /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae/action" status: 202 len: 0 microversion: 2.1 time: 1.161848 Apr 14 18:49:24 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 80/237] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 18:49:23 2023] POST /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae/action => generated 0 bytes in 1164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 18:49:24 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-31fba90b-5406-480c-a23a-6231c333ffe6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:24 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-31fba90b-5406-480c-a23a-6231c333ffe6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-31fba90b-5406-480c-a23a-6231c333ffe6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-31fba90b-5406-480c-a23a-6231c333ffe6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-31fba90b-5406-480c-a23a-6231c333ffe6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-31fba90b-5406-480c-a23a-6231c333ffe6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-31fba90b-5406-480c-a23a-6231c333ffe6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-31fba90b-5406-480c-a23a-6231c333ffe6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:24 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-31fba90b-5406-480c-a23a-6231c333ffe6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e1d31c2d9048699758779dedf7d3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6b4e98cf9e4f96b79c3288dfe0da89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:49:24 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-31fba90b-5406-480c-a23a-6231c333ffe6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae" status: 200 len: 1748 microversion: 2.1 time: 0.185314 Apr 14 18:49:24 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 77/238] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:49:24 2023] GET /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae => generated 1748 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:49:25 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-33a3f3ac-ab75-4a1f-bd42-7b1ab695bd18 req-33286b2d-58ed-4502-bf38-c05658d03118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa09363f-435d-4fa8-9f11-db0c3f4e08be", "name": "network-vif-plugged", "status": "completed", "tag": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620"}, {"name": "network-changed", "server_uuid": "656b9f90-ce93-42cd-aa1b-3ff868162aae", "tag": "324b6810-d265-48bc-a2a9-ff7d4759a910"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-33a3f3ac-ab75-4a1f-bd42-7b1ab695bd18 req-33286b2d-58ed-4502-bf38-c05658d03118 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-33a3f3ac-ab75-4a1f-bd42-7b1ab695bd18 req-33286b2d-58ed-4502-bf38-c05658d03118 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-33a3f3ac-ab75-4a1f-bd42-7b1ab695bd18 req-33286b2d-58ed-4502-bf38-c05658d03118 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:25 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-33a3f3ac-ab75-4a1f-bd42-7b1ab695bd18 req-33286b2d-58ed-4502-bf38-c05658d03118 service nova] Creating event network-vif-plugged:2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance aa09363f-435d-4fa8-9f11-db0c3f4e08be on user Apr 14 18:49:25 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-33a3f3ac-ab75-4a1f-bd42-7b1ab695bd18 req-33286b2d-58ed-4502-bf38-c05658d03118 service nova] Creating event network-changed:324b6810-d265-48bc-a2a9-ff7d4759a910 for instance 656b9f90-ce93-42cd-aa1b-3ff868162aae on user Apr 14 18:49:25 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-33a3f3ac-ab75-4a1f-bd42-7b1ab695bd18 req-33286b2d-58ed-4502-bf38-c05658d03118 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.044416 Apr 14 18:49:25 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 82/239] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:49:25 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:29 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:29 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:29 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:29 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:29 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:29 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:29 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:29 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:29 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "POST /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae/action" status: 202 len: 0 microversion: 2.1 time: 0.136939 Apr 14 18:49:29 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 81/240] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 18:49:29 2023] POST /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:49:29 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-d21700d9-9c2a-4475-b3ba-cf8d9f919f72 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:29 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-d21700d9-9c2a-4475-b3ba-cf8d9f919f72 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:29 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=32 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:49:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d21700d9-9c2a-4475-b3ba-cf8d9f919f72 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d21700d9-9c2a-4475-b3ba-cf8d9f919f72 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d21700d9-9c2a-4475-b3ba-cf8d9f919f72 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d21700d9-9c2a-4475-b3ba-cf8d9f919f72 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d21700d9-9c2a-4475-b3ba-cf8d9f919f72 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d21700d9-9c2a-4475-b3ba-cf8d9f919f72 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:29 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:49:29 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-2889aee7-1497-4f5c-965a-2a0429995726 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:29 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-2889aee7-1497-4f5c-965a-2a0429995726 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:29 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=38 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:49:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-2889aee7-1497-4f5c-965a-2a0429995726 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-2889aee7-1497-4f5c-965a-2a0429995726 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-2889aee7-1497-4f5c-965a-2a0429995726 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-2889aee7-1497-4f5c-965a-2a0429995726 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-2889aee7-1497-4f5c-965a-2a0429995726 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-2889aee7-1497-4f5c-965a-2a0429995726 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:29 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-2889aee7-1497-4f5c-965a-2a0429995726 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/817f112c-d806-4800-9e4a-a3892c54bee1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051610 Apr 14 18:49:29 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 83/241] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:49:29 2023] GET /compute/v2.1/servers/817f112c-d806-4800-9e4a-a3892c54bee1/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 18:49:29 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-d21700d9-9c2a-4475-b3ba-cf8d9f919f72 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e1d31c2d9048699758779dedf7d3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6b4e98cf9e4f96b79c3288dfe0da89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:49:29 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-d21700d9-9c2a-4475-b3ba-cf8d9f919f72 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae" status: 200 len: 1750 microversion: 2.1 time: 0.261058 Apr 14 18:49:29 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 78/242] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:49:29 2023] GET /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae => generated 1750 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:49:29 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-810776822", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "networks": [{"uuid": "054bef1d-1792-4d11-8f1a-974e696a2a77"}]}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:29 user devstack@n-api.service[61675]: DEBUG nova.network.neutron [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] validate_networks() for [('054bef1d-1792-4d11-8f1a-974e696a2a77', None, None, None, None, None)] {{(pid=61675) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:49:30 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Flavor limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:49:30 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Image limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:49:30 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Flavor pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:49:30 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Image pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:49:30 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:49:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:30 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=60,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:49:30 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:49:30 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Getting quotas for project d22a362d9cb946a99c203366f88baafb. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:49:30 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Getting quotas for user 3f78850ecd8042dbac5f24113b9df70e and project d22a362d9cb946a99c203366f88baafb. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:49:30 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Going to run 1 instances... {{(pid=61675) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:49:30 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:49:30 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.934425 Apr 14 18:49:30 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 82/243] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:49:29 2023] POST /compute/v2.1/servers => generated 378 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:49:30 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-07e39cdc-7278-460b-99ea-d675aab37ebf tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:30 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-07e39cdc-7278-460b-99ea-d675aab37ebf tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:30 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-9c5ab3de-21cb-4e0e-9d2d-e8951d231407 req-589a0166-1843-49a4-8ef1-693cfce55bfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "656b9f90-ce93-42cd-aa1b-3ff868162aae", "name": "network-vif-unplugged", "status": "completed", "tag": "324b6810-d265-48bc-a2a9-ff7d4759a910"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:30 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9c5ab3de-21cb-4e0e-9d2d-e8951d231407 req-589a0166-1843-49a4-8ef1-693cfce55bfe service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:30 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9c5ab3de-21cb-4e0e-9d2d-e8951d231407 req-589a0166-1843-49a4-8ef1-693cfce55bfe service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:30 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9c5ab3de-21cb-4e0e-9d2d-e8951d231407 req-589a0166-1843-49a4-8ef1-693cfce55bfe service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:30 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-07e39cdc-7278-460b-99ea-d675aab37ebf tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f78850ecd8042dbac5f24113b9df70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22a362d9cb946a99c203366f88baafb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:49:30 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-07e39cdc-7278-460b-99ea-d675aab37ebf tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/482b8c77-c963-4bc1-8e3c-847650736767" status: 200 len: 1211 microversion: 2.1 time: 0.097759 Apr 14 18:49:30 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 84/244] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:49:30 2023] GET /compute/v2.1/servers/482b8c77-c963-4bc1-8e3c-847650736767 => generated 1211 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 18:49:30 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-9c5ab3de-21cb-4e0e-9d2d-e8951d231407 req-589a0166-1843-49a4-8ef1-693cfce55bfe service nova] Creating event network-vif-unplugged:324b6810-d265-48bc-a2a9-ff7d4759a910 for instance 656b9f90-ce93-42cd-aa1b-3ff868162aae on user Apr 14 18:49:30 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-9c5ab3de-21cb-4e0e-9d2d-e8951d231407 req-589a0166-1843-49a4-8ef1-693cfce55bfe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030226 Apr 14 18:49:30 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 79/245] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:49:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:32 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-b540c086-9e60-4be2-9e83-f24801c892b0 req-dae23598-5fcb-4c7e-8eca-d241e78baa8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "656b9f90-ce93-42cd-aa1b-3ff868162aae", "name": "network-vif-plugged", "status": "completed", "tag": "324b6810-d265-48bc-a2a9-ff7d4759a910"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-b540c086-9e60-4be2-9e83-f24801c892b0 req-dae23598-5fcb-4c7e-8eca-d241e78baa8c service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-b540c086-9e60-4be2-9e83-f24801c892b0 req-dae23598-5fcb-4c7e-8eca-d241e78baa8c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-b540c086-9e60-4be2-9e83-f24801c892b0 req-dae23598-5fcb-4c7e-8eca-d241e78baa8c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:32 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-b540c086-9e60-4be2-9e83-f24801c892b0 req-dae23598-5fcb-4c7e-8eca-d241e78baa8c service nova] Creating event network-vif-plugged:324b6810-d265-48bc-a2a9-ff7d4759a910 for instance 656b9f90-ce93-42cd-aa1b-3ff868162aae on user Apr 14 18:49:32 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-b540c086-9e60-4be2-9e83-f24801c892b0 req-dae23598-5fcb-4c7e-8eca-d241e78baa8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046848 Apr 14 18:49:32 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 83/246] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:49:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:33 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-04d86aea-5c62-4e1a-b66e-672d1707791e tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:33 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-04d86aea-5c62-4e1a-b66e-672d1707791e tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:33 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-04d86aea-5c62-4e1a-b66e-672d1707791e tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:33 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-04d86aea-5c62-4e1a-b66e-672d1707791e tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:33 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-04d86aea-5c62-4e1a-b66e-672d1707791e tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:33 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-04d86aea-5c62-4e1a-b66e-672d1707791e tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:33 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-04d86aea-5c62-4e1a-b66e-672d1707791e tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:33 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-04d86aea-5c62-4e1a-b66e-672d1707791e tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:33 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-04d86aea-5c62-4e1a-b66e-672d1707791e tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] HTTP exception thrown: Instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 could not be found. Apr 14 18:49:33 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-04d86aea-5c62-4e1a-b66e-672d1707791e tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Request method failure captured: Apr 14 18:49:33 user devstack@n-api.service[61674]: request: GET /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8 HTTP/1.1 Apr 14 18:49:33 user devstack@n-api.service[61674]: Accept: application/json Apr 14 18:49:33 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 18:49:33 user devstack@n-api.service[61674]: Connection: close Apr 14 18:49:33 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 18:49:33 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 18:49:33 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 18:49:33 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 18:49:33 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 18:49:33 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOZ9r-a5ZGHAZWFtaZEe2aOgGtNqKFWBbGPFposmAiN2lxMPoB4mGJY3pvdHY_zibtjibyRWKcIPrgrGc4OViSSqaPDaNtZE32LkI9OwvKnp1EP1DoC5ex3Z4g9qBE0dWMi2YyALvpnk_VEXiOnWciWyA0Y0REbtQZHQ4gy23uG4U08I Apr 14 18:49:33 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 18:49:33 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 18:49:33 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 18:49:33 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 18:49:33 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 18:49:33 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 18:49:33 user devstack@n-api.service[61674]: X-Project-Id: 8ef3347089a742cd8533322deb96b4d0 Apr 14 18:49:33 user devstack@n-api.service[61674]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1744957481 Apr 14 18:49:33 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 18:49:33 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 18:49:33 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8ef3347089a742cd8533322deb96b4d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8ef3347089a742cd8533322deb96b4d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8ef3347089a742cd8533322deb96b4d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:49:33 user devstack@n-api.service[61674]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1744957481 Apr 14 18:49:33 user devstack@n-api.service[61674]: X-Tenant-Id: 8ef3347089a742cd8533322deb96b4d0 Apr 14 18:49:33 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1744957481 Apr 14 18:49:33 user devstack@n-api.service[61674]: X-User: tempest-AttachSCSIVolumeTestJSON-1744957481-project-member Apr 14 18:49:33 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 18:49:33 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 18:49:33 user devstack@n-api.service[61674]: X-User-Id: 6224225e832d40e986e1f145295621df Apr 14 18:49:33 user devstack@n-api.service[61674]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1744957481-project-member Apr 14 18:49:33 user devstack@n-api.service[61674]: method: > Apr 14 18:49:33 user devstack@n-api.service[61674]: exception: Instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 could not be found. Apr 14 18:49:33 user devstack@n-api.service[61674]: action_args: {'id': '499df49b-4a00-447b-bd2f-b027fb44f3b8'} Apr 14 18:49:33 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 could not be found. Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 could not be found. Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 could not be found. Apr 14 18:49:33 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:49:33 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-04d86aea-5c62-4e1a-b66e-672d1707791e tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Returning 404 to user: Instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:49:33 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-04d86aea-5c62-4e1a-b66e-672d1707791e tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] 10.0.0.210 "GET /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8" status: 404 len: 111 microversion: 2.1 time: 0.033151 Apr 14 18:49:33 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 85/247] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:49:33 2023] GET /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:49:33 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-3e0ea6ed-f5f0-449c-b13f-98180c0cb27a tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Calling method '.version_select at 0x7fdae119a170>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:33 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-3e0ea6ed-f5f0-449c-b13f-98180c0cb27a tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1864669462" status: 202 len: 0 microversion: 2.1 time: 0.028577 Apr 14 18:49:33 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 80/248] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 18:49:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1864669462 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:49:34 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-f3328402-957c-4dbe-a92f-35028a2abaf2 req-1d1ba2c5-522e-4ec0-93bd-36418bd9b329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "482b8c77-c963-4bc1-8e3c-847650736767", "tag": "38af2537-567f-4c06-b8f5-6e0c46f8dde6"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-f3328402-957c-4dbe-a92f-35028a2abaf2 req-1d1ba2c5-522e-4ec0-93bd-36418bd9b329 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-f3328402-957c-4dbe-a92f-35028a2abaf2 req-1d1ba2c5-522e-4ec0-93bd-36418bd9b329 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-f3328402-957c-4dbe-a92f-35028a2abaf2 req-1d1ba2c5-522e-4ec0-93bd-36418bd9b329 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:34 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-f3328402-957c-4dbe-a92f-35028a2abaf2 req-1d1ba2c5-522e-4ec0-93bd-36418bd9b329 service nova] Creating event network-changed:38af2537-567f-4c06-b8f5-6e0c46f8dde6 for instance 482b8c77-c963-4bc1-8e3c-847650736767 on user Apr 14 18:49:34 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-f3328402-957c-4dbe-a92f-35028a2abaf2 req-1d1ba2c5-522e-4ec0-93bd-36418bd9b329 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045844 Apr 14 18:49:34 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 84/249] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:49:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:38 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-d599976a-1e86-4139-abda-b8e7c4b173d9 req-f5d2ca25-99a4-4e41-8cde-b4592705e260 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa09363f-435d-4fa8-9f11-db0c3f4e08be", "name": "network-vif-plugged", "status": "completed", "tag": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:38 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-d599976a-1e86-4139-abda-b8e7c4b173d9 req-f5d2ca25-99a4-4e41-8cde-b4592705e260 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:38 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-d599976a-1e86-4139-abda-b8e7c4b173d9 req-f5d2ca25-99a4-4e41-8cde-b4592705e260 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:38 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-d599976a-1e86-4139-abda-b8e7c4b173d9 req-f5d2ca25-99a4-4e41-8cde-b4592705e260 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:38 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-575c22d4-64aa-444c-9cf3-d0c129b25e96 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:38 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-d599976a-1e86-4139-abda-b8e7c4b173d9 req-f5d2ca25-99a4-4e41-8cde-b4592705e260 service nova] Creating event network-vif-plugged:2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance aa09363f-435d-4fa8-9f11-db0c3f4e08be on user Apr 14 18:49:38 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-575c22d4-64aa-444c-9cf3-d0c129b25e96 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:38 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-d599976a-1e86-4139-abda-b8e7c4b173d9 req-f5d2ca25-99a4-4e41-8cde-b4592705e260 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077135 Apr 14 18:49:38 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 86/250] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:49:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:38 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-575c22d4-64aa-444c-9cf3-d0c129b25e96 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:38 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-575c22d4-64aa-444c-9cf3-d0c129b25e96 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:38 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-575c22d4-64aa-444c-9cf3-d0c129b25e96 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:38 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-575c22d4-64aa-444c-9cf3-d0c129b25e96 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:38 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-575c22d4-64aa-444c-9cf3-d0c129b25e96 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:38 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-575c22d4-64aa-444c-9cf3-d0c129b25e96 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:38 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-575c22d4-64aa-444c-9cf3-d0c129b25e96 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] HTTP exception thrown: Instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 could not be found. Apr 14 18:49:38 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-575c22d4-64aa-444c-9cf3-d0c129b25e96 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Request method failure captured: Apr 14 18:49:38 user devstack@n-api.service[61673]: request: DELETE /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8 HTTP/1.1 Apr 14 18:49:38 user devstack@n-api.service[61673]: Accept: application/json Apr 14 18:49:38 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 18:49:38 user devstack@n-api.service[61673]: Connection: close Apr 14 18:49:38 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 18:49:38 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 18:49:38 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 18:49:38 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 18:49:38 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 18:49:38 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOZ9r-a5ZGHAZWFtaZEe2aOgGtNqKFWBbGPFposmAiN2lxMPoB4mGJY3pvdHY_zibtjibyRWKcIPrgrGc4OViSSqaPDaNtZE32LkI9OwvKnp1EP1DoC5ex3Z4g9qBE0dWMi2YyALvpnk_VEXiOnWciWyA0Y0REbtQZHQ4gy23uG4U08I Apr 14 18:49:38 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 18:49:38 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 18:49:38 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 18:49:38 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 18:49:38 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 18:49:38 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 18:49:38 user devstack@n-api.service[61673]: X-Project-Id: 8ef3347089a742cd8533322deb96b4d0 Apr 14 18:49:38 user devstack@n-api.service[61673]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1744957481 Apr 14 18:49:38 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 18:49:38 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 18:49:38 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8ef3347089a742cd8533322deb96b4d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8ef3347089a742cd8533322deb96b4d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8ef3347089a742cd8533322deb96b4d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:49:38 user devstack@n-api.service[61673]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1744957481 Apr 14 18:49:38 user devstack@n-api.service[61673]: X-Tenant-Id: 8ef3347089a742cd8533322deb96b4d0 Apr 14 18:49:38 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1744957481 Apr 14 18:49:38 user devstack@n-api.service[61673]: X-User: tempest-AttachSCSIVolumeTestJSON-1744957481-project-member Apr 14 18:49:38 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 18:49:38 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 18:49:38 user devstack@n-api.service[61673]: X-User-Id: 6224225e832d40e986e1f145295621df Apr 14 18:49:38 user devstack@n-api.service[61673]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1744957481-project-member Apr 14 18:49:38 user devstack@n-api.service[61673]: method: > Apr 14 18:49:38 user devstack@n-api.service[61673]: exception: Instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 could not be found. Apr 14 18:49:38 user devstack@n-api.service[61673]: action_args: {'id': '499df49b-4a00-447b-bd2f-b027fb44f3b8'} Apr 14 18:49:38 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 could not be found. Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 could not be found. Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 could not be found. Apr 14 18:49:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:49:38 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-575c22d4-64aa-444c-9cf3-d0c129b25e96 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Returning 404 to user: Instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:49:38 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-575c22d4-64aa-444c-9cf3-d0c129b25e96 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8" status: 404 len: 111 microversion: 2.1 time: 0.065305 Apr 14 18:49:38 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 81/251] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 18:49:38 2023] DELETE /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:49:38 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-29741e3d-2fec-41de-88b5-db006393d5e8 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:38 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-29741e3d-2fec-41de-88b5-db006393d5e8 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-29741e3d-2fec-41de-88b5-db006393d5e8 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-29741e3d-2fec-41de-88b5-db006393d5e8 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-29741e3d-2fec-41de-88b5-db006393d5e8 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-29741e3d-2fec-41de-88b5-db006393d5e8 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-29741e3d-2fec-41de-88b5-db006393d5e8 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-29741e3d-2fec-41de-88b5-db006393d5e8 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:38 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-29741e3d-2fec-41de-88b5-db006393d5e8 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] HTTP exception thrown: Instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 could not be found. Apr 14 18:49:38 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-29741e3d-2fec-41de-88b5-db006393d5e8 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Request method failure captured: Apr 14 18:49:38 user devstack@n-api.service[61675]: request: GET /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8 HTTP/1.1 Apr 14 18:49:38 user devstack@n-api.service[61675]: Accept: application/json Apr 14 18:49:38 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 18:49:38 user devstack@n-api.service[61675]: Connection: close Apr 14 18:49:38 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 18:49:38 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 18:49:38 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 18:49:38 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 18:49:38 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 18:49:38 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOZ9r-a5ZGHAZWFtaZEe2aOgGtNqKFWBbGPFposmAiN2lxMPoB4mGJY3pvdHY_zibtjibyRWKcIPrgrGc4OViSSqaPDaNtZE32LkI9OwvKnp1EP1DoC5ex3Z4g9qBE0dWMi2YyALvpnk_VEXiOnWciWyA0Y0REbtQZHQ4gy23uG4U08I Apr 14 18:49:38 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 18:49:38 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 18:49:38 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 18:49:38 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 18:49:38 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 18:49:38 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 18:49:38 user devstack@n-api.service[61675]: X-Project-Id: 8ef3347089a742cd8533322deb96b4d0 Apr 14 18:49:38 user devstack@n-api.service[61675]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1744957481 Apr 14 18:49:38 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 18:49:38 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 18:49:38 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8ef3347089a742cd8533322deb96b4d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8ef3347089a742cd8533322deb96b4d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8ef3347089a742cd8533322deb96b4d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:49:38 user devstack@n-api.service[61675]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1744957481 Apr 14 18:49:38 user devstack@n-api.service[61675]: X-Tenant-Id: 8ef3347089a742cd8533322deb96b4d0 Apr 14 18:49:38 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1744957481 Apr 14 18:49:38 user devstack@n-api.service[61675]: X-User: tempest-AttachSCSIVolumeTestJSON-1744957481-project-member Apr 14 18:49:38 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 18:49:38 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 18:49:38 user devstack@n-api.service[61675]: X-User-Id: 6224225e832d40e986e1f145295621df Apr 14 18:49:38 user devstack@n-api.service[61675]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1744957481-project-member Apr 14 18:49:38 user devstack@n-api.service[61675]: method: > Apr 14 18:49:38 user devstack@n-api.service[61675]: exception: Instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 could not be found. Apr 14 18:49:38 user devstack@n-api.service[61675]: action_args: {'id': '499df49b-4a00-447b-bd2f-b027fb44f3b8'} Apr 14 18:49:38 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 could not be found. Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 could not be found. Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 could not be found. Apr 14 18:49:38 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:49:38 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-29741e3d-2fec-41de-88b5-db006393d5e8 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Returning 404 to user: Instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:49:38 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-29741e3d-2fec-41de-88b5-db006393d5e8 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] 10.0.0.210 "GET /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8" status: 404 len: 111 microversion: 2.1 time: 0.038909 Apr 14 18:49:38 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 85/252] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:49:38 2023] GET /compute/v2.1/servers/499df49b-4a00-447b-bd2f-b027fb44f3b8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:49:40 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-d3698823-8d9e-4bf1-8002-0741dc04f063 req-40ec35da-6743-4e15-8fee-6182276a3777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "482b8c77-c963-4bc1-8e3c-847650736767", "name": "network-vif-plugged", "status": "completed", "tag": "38af2537-567f-4c06-b8f5-6e0c46f8dde6"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-d3698823-8d9e-4bf1-8002-0741dc04f063 req-40ec35da-6743-4e15-8fee-6182276a3777 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-d3698823-8d9e-4bf1-8002-0741dc04f063 req-40ec35da-6743-4e15-8fee-6182276a3777 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-d3698823-8d9e-4bf1-8002-0741dc04f063 req-40ec35da-6743-4e15-8fee-6182276a3777 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:40 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-d3698823-8d9e-4bf1-8002-0741dc04f063 req-40ec35da-6743-4e15-8fee-6182276a3777 service nova] Creating event network-vif-plugged:38af2537-567f-4c06-b8f5-6e0c46f8dde6 for instance 482b8c77-c963-4bc1-8e3c-847650736767 on user Apr 14 18:49:40 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-d3698823-8d9e-4bf1-8002-0741dc04f063 req-40ec35da-6743-4e15-8fee-6182276a3777 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040543 Apr 14 18:49:40 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 87/253] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:49:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:40 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-bf6e42dd-e8fb-4477-9a42-d1fa9a65bacc req-df94422c-1d31-4b80-832c-54a032e95404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa09363f-435d-4fa8-9f11-db0c3f4e08be", "name": "network-vif-plugged", "status": "completed", "tag": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:40 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-bf6e42dd-e8fb-4477-9a42-d1fa9a65bacc req-df94422c-1d31-4b80-832c-54a032e95404 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:40 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-bf6e42dd-e8fb-4477-9a42-d1fa9a65bacc req-df94422c-1d31-4b80-832c-54a032e95404 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:40 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-bf6e42dd-e8fb-4477-9a42-d1fa9a65bacc req-df94422c-1d31-4b80-832c-54a032e95404 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:40 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-bf6e42dd-e8fb-4477-9a42-d1fa9a65bacc req-df94422c-1d31-4b80-832c-54a032e95404 service nova] Creating event network-vif-plugged:2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance aa09363f-435d-4fa8-9f11-db0c3f4e08be on user Apr 14 18:49:40 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-bf6e42dd-e8fb-4477-9a42-d1fa9a65bacc req-df94422c-1d31-4b80-832c-54a032e95404 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034786 Apr 14 18:49:40 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 82/254] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:49:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:42 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-3dbb10d3-a758-45ed-84f2-bd695617ef50 req-cee037d9-dbda-4984-b20a-23158527e29e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "482b8c77-c963-4bc1-8e3c-847650736767", "name": "network-vif-plugged", "status": "completed", "tag": "38af2537-567f-4c06-b8f5-6e0c46f8dde6"}, {"server_uuid": "656b9f90-ce93-42cd-aa1b-3ff868162aae", "name": "network-vif-plugged", "status": "completed", "tag": "324b6810-d265-48bc-a2a9-ff7d4759a910"}, {"server_uuid": "656b9f90-ce93-42cd-aa1b-3ff868162aae", "name": "network-vif-plugged", "status": "completed", "tag": "324b6810-d265-48bc-a2a9-ff7d4759a910"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:42 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:49:42 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=6 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:49:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-3dbb10d3-a758-45ed-84f2-bd695617ef50 req-cee037d9-dbda-4984-b20a-23158527e29e service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-3dbb10d3-a758-45ed-84f2-bd695617ef50 req-cee037d9-dbda-4984-b20a-23158527e29e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-3dbb10d3-a758-45ed-84f2-bd695617ef50 req-cee037d9-dbda-4984-b20a-23158527e29e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:42 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-3dbb10d3-a758-45ed-84f2-bd695617ef50 req-cee037d9-dbda-4984-b20a-23158527e29e service nova] Creating event network-vif-plugged:38af2537-567f-4c06-b8f5-6e0c46f8dde6 for instance 482b8c77-c963-4bc1-8e3c-847650736767 on user Apr 14 18:49:42 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-3dbb10d3-a758-45ed-84f2-bd695617ef50 req-cee037d9-dbda-4984-b20a-23158527e29e service nova] Creating event network-vif-plugged:324b6810-d265-48bc-a2a9-ff7d4759a910 for instance 656b9f90-ce93-42cd-aa1b-3ff868162aae on user Apr 14 18:49:42 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-3dbb10d3-a758-45ed-84f2-bd695617ef50 req-cee037d9-dbda-4984-b20a-23158527e29e service nova] Creating event network-vif-plugged:324b6810-d265-48bc-a2a9-ff7d4759a910 for instance 656b9f90-ce93-42cd-aa1b-3ff868162aae on user Apr 14 18:49:42 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-3dbb10d3-a758-45ed-84f2-bd695617ef50 req-cee037d9-dbda-4984-b20a-23158527e29e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.076000 Apr 14 18:49:42 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 86/255] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:49:42 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:42 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:49:42 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-6929fc51-52ae-4887-bc28-8079ebf81df4 tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:42 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-6929fc51-52ae-4887-bc28-8079ebf81df4 tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6929fc51-52ae-4887-bc28-8079ebf81df4 tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6929fc51-52ae-4887-bc28-8079ebf81df4 tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6929fc51-52ae-4887-bc28-8079ebf81df4 tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6929fc51-52ae-4887-bc28-8079ebf81df4 tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6929fc51-52ae-4887-bc28-8079ebf81df4 tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6929fc51-52ae-4887-bc28-8079ebf81df4 tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:42 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-6929fc51-52ae-4887-bc28-8079ebf81df4 tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/os-instance-actions/req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd" status: 200 len: 503 microversion: 2.49 time: 0.055722 Apr 14 18:49:42 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 88/256] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 18:49:42 2023] GET /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/os-instance-actions/req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd => generated 503 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 18:49:42 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-829f1001-e19f-4cc4-9e1a-d82051a34b80 tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:42 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-829f1001-e19f-4cc4-9e1a-d82051a34b80 tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-829f1001-e19f-4cc4-9e1a-d82051a34b80 tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-829f1001-e19f-4cc4-9e1a-d82051a34b80 tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-829f1001-e19f-4cc4-9e1a-d82051a34b80 tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-829f1001-e19f-4cc4-9e1a-d82051a34b80 tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-829f1001-e19f-4cc4-9e1a-d82051a34b80 tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-829f1001-e19f-4cc4-9e1a-d82051a34b80 tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:42 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-829f1001-e19f-4cc4-9e1a-d82051a34b80 tempest-TaggedAttachmentsTest-915675247 tempest-TaggedAttachmentsTest-915675247-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/os-instance-actions/req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd" status: 200 len: 503 microversion: 2.49 time: 0.060009 Apr 14 18:49:42 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 83/257] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 18:49:42 2023] GET /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/os-instance-actions/req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd => generated 503 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 18:49:42 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-c3e1019e-d5c6-475d-8e7f-7966806a2d4f tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:42 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-c3e1019e-d5c6-475d-8e7f-7966806a2d4f tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c3e1019e-d5c6-475d-8e7f-7966806a2d4f tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c3e1019e-d5c6-475d-8e7f-7966806a2d4f tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c3e1019e-d5c6-475d-8e7f-7966806a2d4f tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c3e1019e-d5c6-475d-8e7f-7966806a2d4f tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c3e1019e-d5c6-475d-8e7f-7966806a2d4f tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c3e1019e-d5c6-475d-8e7f-7966806a2d4f tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:42 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-c3e1019e-d5c6-475d-8e7f-7966806a2d4f tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.054444 Apr 14 18:49:42 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 87/258] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 18:49:42 2023] GET /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:49:42 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:42 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:43 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Going to try to terminate instance {{(pid=61674) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 18:49:43 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" status: 204 len: 0 microversion: 2.49 time: 0.266782 Apr 14 18:49:43 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 89/259] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 18:49:42 2023] DELETE /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 18:49:43 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-11d30630-95ba-4cbe-8118-28c7e679e024 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:43 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-11d30630-95ba-4cbe-8118-28c7e679e024 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:43 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-11d30630-95ba-4cbe-8118-28c7e679e024 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:43 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-11d30630-95ba-4cbe-8118-28c7e679e024 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:43 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-11d30630-95ba-4cbe-8118-28c7e679e024 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:43 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-11d30630-95ba-4cbe-8118-28c7e679e024 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:43 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-11d30630-95ba-4cbe-8118-28c7e679e024 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:43 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-11d30630-95ba-4cbe-8118-28c7e679e024 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:43 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-11d30630-95ba-4cbe-8118-28c7e679e024 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b083d961ab7546a7bb743d034c5e0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efae74f239e14c29b3af28c7fceee94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:49:43 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-11d30630-95ba-4cbe-8118-28c7e679e024 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b083d961ab7546a7bb743d034c5e0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efae74f239e14c29b3af28c7fceee94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:49:43 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-11d30630-95ba-4cbe-8118-28c7e679e024 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b083d961ab7546a7bb743d034c5e0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efae74f239e14c29b3af28c7fceee94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:49:43 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-11d30630-95ba-4cbe-8118-28c7e679e024 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" status: 200 len: 1753 microversion: 2.49 time: 0.466980 Apr 14 18:49:43 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 84/260] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:49:43 2023] GET /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 => generated 1753 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:49:44 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-c21dfbe1-9956-4dec-8c8e-1bc1e6c4af99 req-1bd2284c-15db-4ba1-8d11-81e521ef109b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99", "name": "network-vif-unplugged", "status": "completed", "tag": "a23ae571-1be9-4877-b629-567eb9c62b9d"}, {"server_uuid": "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99", "name": "network-vif-plugged", "status": "completed", "tag": "a23ae571-1be9-4877-b629-567eb9c62b9d"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:44 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-c21dfbe1-9956-4dec-8c8e-1bc1e6c4af99 req-1bd2284c-15db-4ba1-8d11-81e521ef109b service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:44 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-c21dfbe1-9956-4dec-8c8e-1bc1e6c4af99 req-1bd2284c-15db-4ba1-8d11-81e521ef109b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:44 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-c21dfbe1-9956-4dec-8c8e-1bc1e6c4af99 req-1bd2284c-15db-4ba1-8d11-81e521ef109b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:44 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-c21dfbe1-9956-4dec-8c8e-1bc1e6c4af99 req-1bd2284c-15db-4ba1-8d11-81e521ef109b service nova] Creating event network-vif-unplugged:a23ae571-1be9-4877-b629-567eb9c62b9d for instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 on user Apr 14 18:49:44 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-c21dfbe1-9956-4dec-8c8e-1bc1e6c4af99 req-1bd2284c-15db-4ba1-8d11-81e521ef109b service nova] Creating event network-vif-plugged:a23ae571-1be9-4877-b629-567eb9c62b9d for instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 on user Apr 14 18:49:44 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-c21dfbe1-9956-4dec-8c8e-1bc1e6c4af99 req-1bd2284c-15db-4ba1-8d11-81e521ef109b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.051031 Apr 14 18:49:44 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 88/261] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:49:44 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:44 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-39a3656d-4ecf-4aec-bc0f-581698239a67 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:44 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-39a3656d-4ecf-4aec-bc0f-581698239a67 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:44 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-39a3656d-4ecf-4aec-bc0f-581698239a67 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:44 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-39a3656d-4ecf-4aec-bc0f-581698239a67 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:44 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-39a3656d-4ecf-4aec-bc0f-581698239a67 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:44 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-39a3656d-4ecf-4aec-bc0f-581698239a67 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:44 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-39a3656d-4ecf-4aec-bc0f-581698239a67 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:44 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-39a3656d-4ecf-4aec-bc0f-581698239a67 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:44 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-39a3656d-4ecf-4aec-bc0f-581698239a67 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] HTTP exception thrown: Instance a3378ec4-364a-4656-ac99-500be9d40749 could not be found. Apr 14 18:49:45 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-39a3656d-4ecf-4aec-bc0f-581698239a67 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Request method failure captured: Apr 14 18:49:45 user devstack@n-api.service[61674]: request: GET /compute/v2.1/servers/a3378ec4-364a-4656-ac99-500be9d40749 HTTP/1.1 Apr 14 18:49:45 user devstack@n-api.service[61674]: Accept: application/json Apr 14 18:49:45 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 18:49:45 user devstack@n-api.service[61674]: Connection: close Apr 14 18:49:45 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 18:49:45 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 18:49:45 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 18:49:45 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 18:49:45 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 18:49:45 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOZ9tOGOAhnrEBwBVzWIspbKzUbQswOnM4e0xuJzpmDT2b3J31Wh990--Sd4EG9x11uEnGoE2MobmxRfwvSSu349l6uZXbGGyoi1qjlFmD9jnJmW7hIWG5nWel5ZxWM_C-97asJUzR22d7TtbUTz0vfugI7t4UpcYaY0n9oQklvBr7l4 Apr 14 18:49:45 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 18:49:45 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 18:49:45 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 18:49:45 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 18:49:45 user devstack@n-api.service[61674]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 18:49:45 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 18:49:45 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 18:49:45 user devstack@n-api.service[61674]: X-Project-Id: 72ec916e861d448a853251f522699446 Apr 14 18:49:45 user devstack@n-api.service[61674]: X-Project-Name: tempest-TaggedBootDevicesTest-621954698 Apr 14 18:49:45 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 18:49:45 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 18:49:45 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72ec916e861d448a853251f522699446"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72ec916e861d448a853251f522699446"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72ec916e861d448a853251f522699446"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:49:45 user devstack@n-api.service[61674]: X-Tenant: tempest-TaggedBootDevicesTest-621954698 Apr 14 18:49:45 user devstack@n-api.service[61674]: X-Tenant-Id: 72ec916e861d448a853251f522699446 Apr 14 18:49:45 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-TaggedBootDevicesTest-621954698 Apr 14 18:49:45 user devstack@n-api.service[61674]: X-User: tempest-TaggedBootDevicesTest-621954698-project-member Apr 14 18:49:45 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 18:49:45 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 18:49:45 user devstack@n-api.service[61674]: X-User-Id: d4dc36f0048042929d1230f99e2be306 Apr 14 18:49:45 user devstack@n-api.service[61674]: X-User-Name: tempest-TaggedBootDevicesTest-621954698-project-member Apr 14 18:49:45 user devstack@n-api.service[61674]: method: > Apr 14 18:49:45 user devstack@n-api.service[61674]: exception: Instance a3378ec4-364a-4656-ac99-500be9d40749 could not be found. Apr 14 18:49:45 user devstack@n-api.service[61674]: action_args: {'id': 'a3378ec4-364a-4656-ac99-500be9d40749'} Apr 14 18:49:45 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3378ec4-364a-4656-ac99-500be9d40749 could not be found. Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3378ec4-364a-4656-ac99-500be9d40749 could not be found. Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3378ec4-364a-4656-ac99-500be9d40749 could not be found. Apr 14 18:49:45 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:49:45 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-39a3656d-4ecf-4aec-bc0f-581698239a67 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Returning 404 to user: Instance a3378ec4-364a-4656-ac99-500be9d40749 could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:49:45 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-39a3656d-4ecf-4aec-bc0f-581698239a67 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3378ec4-364a-4656-ac99-500be9d40749" status: 404 len: 111 microversion: 2.32 time: 0.044999 Apr 14 18:49:45 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 90/262] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:49:44 2023] GET /compute/v2.1/servers/a3378ec4-364a-4656-ac99-500be9d40749 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 18:49:45 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-6cfbd6ac-caef-4bac-8b58-a3f655a807e6 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Calling method '.version_select at 0x7fdae1034f70>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:45 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-6cfbd6ac-caef-4bac-8b58-a3f655a807e6 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1451762100" status: 204 len: 0 microversion: 2.32 time: 0.026117 Apr 14 18:49:45 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 85/263] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 18:49:45 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1451762100 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 18:49:45 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:45 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:45 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:45 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:45 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:45 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:45 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:45 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:45 user devstack@n-api.service[61675]: DEBUG nova.objects.instance [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lazy-loading 'services' on Instance uuid 2c4f47d7-95da-4a01-b6e6-eb14933fede7 {{(pid=61675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 18:49:45 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2c4f47d7-95da-4a01-b6e6-eb14933fede7/os-volume_attachments/2b5b5249-f5b0-4713-81d6-7593e5705ae1" status: 202 len: 0 microversion: 2.1 time: 0.235832 Apr 14 18:49:45 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 89/264] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 18:49:45 2023] DELETE /compute/v2.1/servers/2c4f47d7-95da-4a01-b6e6-eb14933fede7/os-volume_attachments/2b5b5249-f5b0-4713-81d6-7593e5705ae1 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:49:45 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:45 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:45 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:45 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:45 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:45 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:45 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:45 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:45 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Going to try to terminate instance {{(pid=61674) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 18:49:45 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2c4f47d7-95da-4a01-b6e6-eb14933fede7" status: 204 len: 0 microversion: 2.1 time: 0.175963 Apr 14 18:49:45 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 91/265] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 18:49:45 2023] DELETE /compute/v2.1/servers/2c4f47d7-95da-4a01-b6e6-eb14933fede7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 18:49:45 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-d866075e-9f47-4b7e-bc4d-240c6e3dcc87 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:45 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-d866075e-9f47-4b7e-bc4d-240c6e3dcc87 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:45 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d866075e-9f47-4b7e-bc4d-240c6e3dcc87 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:45 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d866075e-9f47-4b7e-bc4d-240c6e3dcc87 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:45 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d866075e-9f47-4b7e-bc4d-240c6e3dcc87 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:45 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d866075e-9f47-4b7e-bc4d-240c6e3dcc87 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:45 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d866075e-9f47-4b7e-bc4d-240c6e3dcc87 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:45 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d866075e-9f47-4b7e-bc4d-240c6e3dcc87 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:46 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-d866075e-9f47-4b7e-bc4d-240c6e3dcc87 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3f788e144c46e7bdf6f4fe3a5aeb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95319509fb6a4e58998703975370877a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:49:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99", "name": "network-vif-plugged", "status": "completed", "tag": "a23ae571-1be9-4877-b629-567eb9c62b9d"}, {"server_uuid": "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99", "name": "network-vif-plugged", "status": "completed", "tag": "a23ae571-1be9-4877-b629-567eb9c62b9d"}, {"server_uuid": "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99", "name": "network-vif-unplugged", "status": "completed", "tag": "a23ae571-1be9-4877-b629-567eb9c62b9d"}, {"server_uuid": "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99", "name": "network-vif-plugged", "status": "completed", "tag": "a23ae571-1be9-4877-b629-567eb9c62b9d"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:46 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-d866075e-9f47-4b7e-bc4d-240c6e3dcc87 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c4f47d7-95da-4a01-b6e6-eb14933fede7" status: 200 len: 1548 microversion: 2.1 time: 0.728696 Apr 14 18:49:46 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 86/266] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:49:45 2023] GET /compute/v2.1/servers/2c4f47d7-95da-4a01-b6e6-eb14933fede7 => generated 1548 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 18:49:46 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:46 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:46 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:46 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] Creating event network-vif-plugged:a23ae571-1be9-4877-b629-567eb9c62b9d for instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 on user Apr 14 18:49:46 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] Creating event network-vif-plugged:a23ae571-1be9-4877-b629-567eb9c62b9d for instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 on user Apr 14 18:49:46 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] Creating event network-vif-unplugged:a23ae571-1be9-4877-b629-567eb9c62b9d for instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 on user Apr 14 18:49:46 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] Creating event network-vif-plugged:a23ae571-1be9-4877-b629-567eb9c62b9d for instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 on user Apr 14 18:49:46 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.077513 Apr 14 18:49:46 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 90/267] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:49:46 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-b1a30cb8-c7c8-4fc3-a449-8eab935e4f3d req-30aa82fc-2ef4-4abc-9b1d-1475cc17da92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99", "name": "network-vif-deleted", "tag": "a23ae571-1be9-4877-b629-567eb9c62b9d"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:46 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-b1a30cb8-c7c8-4fc3-a449-8eab935e4f3d req-30aa82fc-2ef4-4abc-9b1d-1475cc17da92 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:46 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-b1a30cb8-c7c8-4fc3-a449-8eab935e4f3d req-30aa82fc-2ef4-4abc-9b1d-1475cc17da92 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:46 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-b1a30cb8-c7c8-4fc3-a449-8eab935e4f3d req-30aa82fc-2ef4-4abc-9b1d-1475cc17da92 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:46 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-b1a30cb8-c7c8-4fc3-a449-8eab935e4f3d req-30aa82fc-2ef4-4abc-9b1d-1475cc17da92 service nova] Creating event network-vif-deleted:a23ae571-1be9-4877-b629-567eb9c62b9d for instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 on user Apr 14 18:49:46 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-b1a30cb8-c7c8-4fc3-a449-8eab935e4f3d req-30aa82fc-2ef4-4abc-9b1d-1475cc17da92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046479 Apr 14 18:49:46 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 92/268] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:49:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:48 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-4ea0ebff-e7f2-43fe-86fa-df0d4d6ee49b req-f2c11d2d-780b-4720-b4fe-1a000f12ba60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4f47d7-95da-4a01-b6e6-eb14933fede7", "name": "network-vif-unplugged", "status": "completed", "tag": "58380bee-fc13-4cb4-880d-8f6ce124b16f"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:48 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-4ea0ebff-e7f2-43fe-86fa-df0d4d6ee49b req-f2c11d2d-780b-4720-b4fe-1a000f12ba60 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:48 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-4ea0ebff-e7f2-43fe-86fa-df0d4d6ee49b req-f2c11d2d-780b-4720-b4fe-1a000f12ba60 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:48 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-4ea0ebff-e7f2-43fe-86fa-df0d4d6ee49b req-f2c11d2d-780b-4720-b4fe-1a000f12ba60 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:48 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-4ea0ebff-e7f2-43fe-86fa-df0d4d6ee49b req-f2c11d2d-780b-4720-b4fe-1a000f12ba60 service nova] Creating event network-vif-unplugged:58380bee-fc13-4cb4-880d-8f6ce124b16f for instance 2c4f47d7-95da-4a01-b6e6-eb14933fede7 on user Apr 14 18:49:48 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-4ea0ebff-e7f2-43fe-86fa-df0d4d6ee49b req-f2c11d2d-780b-4720-b4fe-1a000f12ba60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053026 Apr 14 18:49:48 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 87/269] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:49:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:50 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-e130d0f4-1ee7-4968-8b5e-ec436499eeb0 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:50 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-e130d0f4-1ee7-4968-8b5e-ec436499eeb0 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e130d0f4-1ee7-4968-8b5e-ec436499eeb0 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e130d0f4-1ee7-4968-8b5e-ec436499eeb0 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e130d0f4-1ee7-4968-8b5e-ec436499eeb0 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e130d0f4-1ee7-4968-8b5e-ec436499eeb0 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e130d0f4-1ee7-4968-8b5e-ec436499eeb0 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e130d0f4-1ee7-4968-8b5e-ec436499eeb0 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:50 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-669ad0a2-1907-41ee-8c92-62098af27865 req-154a4551-21d1-44f6-b36b-b87ab3b02069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4f47d7-95da-4a01-b6e6-eb14933fede7", "name": "network-vif-deleted", "tag": "58380bee-fc13-4cb4-880d-8f6ce124b16f"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:50 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-e130d0f4-1ee7-4968-8b5e-ec436499eeb0 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] HTTP exception thrown: Instance a3378ec4-364a-4656-ac99-500be9d40749 could not be found. Apr 14 18:49:50 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-e130d0f4-1ee7-4968-8b5e-ec436499eeb0 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Request method failure captured: Apr 14 18:49:50 user devstack@n-api.service[61675]: request: DELETE /compute/v2.1/servers/a3378ec4-364a-4656-ac99-500be9d40749 HTTP/1.1 Apr 14 18:49:50 user devstack@n-api.service[61675]: Accept: application/json Apr 14 18:49:50 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 18:49:50 user devstack@n-api.service[61675]: Connection: close Apr 14 18:49:50 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 18:49:50 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 18:49:50 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 18:49:50 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 18:49:50 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 18:49:50 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOZ9tOGOAhnrEBwBVzWIspbKzUbQswOnM4e0xuJzpmDT2b3J31Wh990--Sd4EG9x11uEnGoE2MobmxRfwvSSu349l6uZXbGGyoi1qjlFmD9jnJmW7hIWG5nWel5ZxWM_C-97asJUzR22d7TtbUTz0vfugI7t4UpcYaY0n9oQklvBr7l4 Apr 14 18:49:50 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 18:49:50 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 18:49:50 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 18:49:50 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 18:49:50 user devstack@n-api.service[61675]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 18:49:50 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 18:49:50 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 18:49:50 user devstack@n-api.service[61675]: X-Project-Id: 72ec916e861d448a853251f522699446 Apr 14 18:49:50 user devstack@n-api.service[61675]: X-Project-Name: tempest-TaggedBootDevicesTest-621954698 Apr 14 18:49:50 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 18:49:50 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 18:49:50 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72ec916e861d448a853251f522699446"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72ec916e861d448a853251f522699446"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72ec916e861d448a853251f522699446"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:49:50 user devstack@n-api.service[61675]: X-Tenant: tempest-TaggedBootDevicesTest-621954698 Apr 14 18:49:50 user devstack@n-api.service[61675]: X-Tenant-Id: 72ec916e861d448a853251f522699446 Apr 14 18:49:50 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-TaggedBootDevicesTest-621954698 Apr 14 18:49:50 user devstack@n-api.service[61675]: X-User: tempest-TaggedBootDevicesTest-621954698-project-member Apr 14 18:49:50 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 18:49:50 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 18:49:50 user devstack@n-api.service[61675]: X-User-Id: d4dc36f0048042929d1230f99e2be306 Apr 14 18:49:50 user devstack@n-api.service[61675]: X-User-Name: tempest-TaggedBootDevicesTest-621954698-project-member Apr 14 18:49:50 user devstack@n-api.service[61675]: method: > Apr 14 18:49:50 user devstack@n-api.service[61675]: exception: Instance a3378ec4-364a-4656-ac99-500be9d40749 could not be found. Apr 14 18:49:50 user devstack@n-api.service[61675]: action_args: {'id': 'a3378ec4-364a-4656-ac99-500be9d40749'} Apr 14 18:49:50 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3378ec4-364a-4656-ac99-500be9d40749 could not be found. Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3378ec4-364a-4656-ac99-500be9d40749 could not be found. Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3378ec4-364a-4656-ac99-500be9d40749 could not be found. Apr 14 18:49:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:49:50 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-e130d0f4-1ee7-4968-8b5e-ec436499eeb0 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Returning 404 to user: Instance a3378ec4-364a-4656-ac99-500be9d40749 could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:49:50 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-e130d0f4-1ee7-4968-8b5e-ec436499eeb0 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a3378ec4-364a-4656-ac99-500be9d40749" status: 404 len: 111 microversion: 2.32 time: 0.060080 Apr 14 18:49:50 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 91/270] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 18:49:50 2023] DELETE /compute/v2.1/servers/a3378ec4-364a-4656-ac99-500be9d40749 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 18:49:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-669ad0a2-1907-41ee-8c92-62098af27865 req-154a4551-21d1-44f6-b36b-b87ab3b02069 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-669ad0a2-1907-41ee-8c92-62098af27865 req-154a4551-21d1-44f6-b36b-b87ab3b02069 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-669ad0a2-1907-41ee-8c92-62098af27865 req-154a4551-21d1-44f6-b36b-b87ab3b02069 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:50 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-87fd7e6e-dff2-43cc-953a-07f7ea9095ed tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:50 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-87fd7e6e-dff2-43cc-953a-07f7ea9095ed tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:50 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-669ad0a2-1907-41ee-8c92-62098af27865 req-154a4551-21d1-44f6-b36b-b87ab3b02069 service nova] Creating event network-vif-deleted:58380bee-fc13-4cb4-880d-8f6ce124b16f for instance 2c4f47d7-95da-4a01-b6e6-eb14933fede7 on user Apr 14 18:49:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-87fd7e6e-dff2-43cc-953a-07f7ea9095ed tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-87fd7e6e-dff2-43cc-953a-07f7ea9095ed tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-87fd7e6e-dff2-43cc-953a-07f7ea9095ed tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-87fd7e6e-dff2-43cc-953a-07f7ea9095ed tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:50 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-669ad0a2-1907-41ee-8c92-62098af27865 req-154a4551-21d1-44f6-b36b-b87ab3b02069 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065147 Apr 14 18:49:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-87fd7e6e-dff2-43cc-953a-07f7ea9095ed tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:50 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 93/271] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:49:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-87fd7e6e-dff2-43cc-953a-07f7ea9095ed tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:50 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-87fd7e6e-dff2-43cc-953a-07f7ea9095ed tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] HTTP exception thrown: Instance a3378ec4-364a-4656-ac99-500be9d40749 could not be found. Apr 14 18:49:50 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-87fd7e6e-dff2-43cc-953a-07f7ea9095ed tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Request method failure captured: Apr 14 18:49:50 user devstack@n-api.service[61673]: request: GET /compute/v2.1/servers/a3378ec4-364a-4656-ac99-500be9d40749 HTTP/1.1 Apr 14 18:49:50 user devstack@n-api.service[61673]: Accept: application/json Apr 14 18:49:50 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 18:49:50 user devstack@n-api.service[61673]: Connection: close Apr 14 18:49:50 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 18:49:50 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 18:49:50 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 18:49:50 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 18:49:50 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 18:49:50 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOZ9tOGOAhnrEBwBVzWIspbKzUbQswOnM4e0xuJzpmDT2b3J31Wh990--Sd4EG9x11uEnGoE2MobmxRfwvSSu349l6uZXbGGyoi1qjlFmD9jnJmW7hIWG5nWel5ZxWM_C-97asJUzR22d7TtbUTz0vfugI7t4UpcYaY0n9oQklvBr7l4 Apr 14 18:49:50 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 18:49:50 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 18:49:50 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 18:49:50 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 18:49:50 user devstack@n-api.service[61673]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 18:49:50 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 18:49:50 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 18:49:50 user devstack@n-api.service[61673]: X-Project-Id: 72ec916e861d448a853251f522699446 Apr 14 18:49:50 user devstack@n-api.service[61673]: X-Project-Name: tempest-TaggedBootDevicesTest-621954698 Apr 14 18:49:50 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 18:49:50 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 18:49:50 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72ec916e861d448a853251f522699446"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72ec916e861d448a853251f522699446"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72ec916e861d448a853251f522699446"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:49:50 user devstack@n-api.service[61673]: X-Tenant: tempest-TaggedBootDevicesTest-621954698 Apr 14 18:49:50 user devstack@n-api.service[61673]: X-Tenant-Id: 72ec916e861d448a853251f522699446 Apr 14 18:49:50 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-TaggedBootDevicesTest-621954698 Apr 14 18:49:50 user devstack@n-api.service[61673]: X-User: tempest-TaggedBootDevicesTest-621954698-project-member Apr 14 18:49:50 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 18:49:50 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 18:49:50 user devstack@n-api.service[61673]: X-User-Id: d4dc36f0048042929d1230f99e2be306 Apr 14 18:49:50 user devstack@n-api.service[61673]: X-User-Name: tempest-TaggedBootDevicesTest-621954698-project-member Apr 14 18:49:50 user devstack@n-api.service[61673]: method: > Apr 14 18:49:50 user devstack@n-api.service[61673]: exception: Instance a3378ec4-364a-4656-ac99-500be9d40749 could not be found. Apr 14 18:49:50 user devstack@n-api.service[61673]: action_args: {'id': 'a3378ec4-364a-4656-ac99-500be9d40749'} Apr 14 18:49:50 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3378ec4-364a-4656-ac99-500be9d40749 could not be found. Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3378ec4-364a-4656-ac99-500be9d40749 could not be found. Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3378ec4-364a-4656-ac99-500be9d40749 could not be found. Apr 14 18:49:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:49:50 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-87fd7e6e-dff2-43cc-953a-07f7ea9095ed tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Returning 404 to user: Instance a3378ec4-364a-4656-ac99-500be9d40749 could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:49:50 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-87fd7e6e-dff2-43cc-953a-07f7ea9095ed tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3378ec4-364a-4656-ac99-500be9d40749" status: 404 len: 111 microversion: 2.32 time: 0.034725 Apr 14 18:49:50 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 88/272] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:49:50 2023] GET /compute/v2.1/servers/a3378ec4-364a-4656-ac99-500be9d40749 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 14 18:49:50 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-dbcba68a-2623-4e8d-8a35-f3f1bc5d2620 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:50 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-dbcba68a-2623-4e8d-8a35-f3f1bc5d2620 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-dbcba68a-2623-4e8d-8a35-f3f1bc5d2620 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-dbcba68a-2623-4e8d-8a35-f3f1bc5d2620 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-dbcba68a-2623-4e8d-8a35-f3f1bc5d2620 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-dbcba68a-2623-4e8d-8a35-f3f1bc5d2620 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-dbcba68a-2623-4e8d-8a35-f3f1bc5d2620 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-dbcba68a-2623-4e8d-8a35-f3f1bc5d2620 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:50 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-f3bcbc52-e6ed-496b-bc1f-783f8d89dabb req-0123711c-8f77-4a59-826f-3f52a02b6617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4f47d7-95da-4a01-b6e6-eb14933fede7", "name": "network-vif-plugged", "status": "completed", "tag": "58380bee-fc13-4cb4-880d-8f6ce124b16f"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:49:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-f3bcbc52-e6ed-496b-bc1f-783f8d89dabb req-0123711c-8f77-4a59-826f-3f52a02b6617 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-f3bcbc52-e6ed-496b-bc1f-783f8d89dabb req-0123711c-8f77-4a59-826f-3f52a02b6617 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-f3bcbc52-e6ed-496b-bc1f-783f8d89dabb req-0123711c-8f77-4a59-826f-3f52a02b6617 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:50 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-f3bcbc52-e6ed-496b-bc1f-783f8d89dabb req-0123711c-8f77-4a59-826f-3f52a02b6617 service nova] Creating event network-vif-plugged:58380bee-fc13-4cb4-880d-8f6ce124b16f for instance 2c4f47d7-95da-4a01-b6e6-eb14933fede7 on user Apr 14 18:49:50 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-f3bcbc52-e6ed-496b-bc1f-783f8d89dabb req-0123711c-8f77-4a59-826f-3f52a02b6617 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039285 Apr 14 18:49:50 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 94/273] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:49:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:49:50 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-dbcba68a-2623-4e8d-8a35-f3f1bc5d2620 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:49:50 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-dbcba68a-2623-4e8d-8a35-f3f1bc5d2620 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:49:50 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-dbcba68a-2623-4e8d-8a35-f3f1bc5d2620 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:49:50 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-dbcba68a-2623-4e8d-8a35-f3f1bc5d2620 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23d14a51-41aa-4827-bd60-c605d9689bc8" status: 200 len: 1768 microversion: 2.87 time: 0.345627 Apr 14 18:49:50 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 92/274] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:49:50 2023] GET /compute/v2.1/servers/23d14a51-41aa-4827-bd60-c605d9689bc8 => generated 1768 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:49:55 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-4bb5840a-6251-41af-981e-80f105df1dba tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:49:55 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-4bb5840a-6251-41af-981e-80f105df1dba tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:49:55 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4bb5840a-6251-41af-981e-80f105df1dba tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:55 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4bb5840a-6251-41af-981e-80f105df1dba tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:55 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4bb5840a-6251-41af-981e-80f105df1dba tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:55 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4bb5840a-6251-41af-981e-80f105df1dba tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:49:55 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4bb5840a-6251-41af-981e-80f105df1dba tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:49:55 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4bb5840a-6251-41af-981e-80f105df1dba tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:49:56 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-4bb5840a-6251-41af-981e-80f105df1dba tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ed7885e7774691b02c19cf08c2177f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d84c59848f445a90eb7eab6be04253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:49:56 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-4bb5840a-6251-41af-981e-80f105df1dba tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c" status: 200 len: 1673 microversion: 2.1 time: 0.567719 Apr 14 18:49:56 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 89/275] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:49:55 2023] GET /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c => generated 1673 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:50:00 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e73ec3ca-6e83-4144-8fe7-315e5ee57a71"}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:00 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:50:00 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:50:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:00 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:50:00 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.412740 Apr 14 18:50:00 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 95/276] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 18:49:59 2023] POST /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c/os-volume_attachments => generated 194 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:50:05 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-58f824b0-aadf-41f8-aa41-6bd053831556 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:50:05 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-58f824b0-aadf-41f8-aa41-6bd053831556 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:50:05 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:50:05 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:50:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-58f824b0-aadf-41f8-aa41-6bd053831556 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-58f824b0-aadf-41f8-aa41-6bd053831556 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-58f824b0-aadf-41f8-aa41-6bd053831556 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-58f824b0-aadf-41f8-aa41-6bd053831556 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-58f824b0-aadf-41f8-aa41-6bd053831556 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-58f824b0-aadf-41f8-aa41-6bd053831556 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:06 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-58f824b0-aadf-41f8-aa41-6bd053831556 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.628633 Apr 14 18:50:06 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 93/277] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 18:50:05 2023] GET /compute/v2.1/servers/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/os-interface => generated 282 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:50:06 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-307e76e9-556f-4ec4-8661-d5bb3eee0886 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:50:06 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-307e76e9-556f-4ec4-8661-d5bb3eee0886 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:50:06 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:50:06 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=41 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:50:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-307e76e9-556f-4ec4-8661-d5bb3eee0886 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-307e76e9-556f-4ec4-8661-d5bb3eee0886 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-307e76e9-556f-4ec4-8661-d5bb3eee0886 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-307e76e9-556f-4ec4-8661-d5bb3eee0886 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-307e76e9-556f-4ec4-8661-d5bb3eee0886 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-307e76e9-556f-4ec4-8661-d5bb3eee0886 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:06 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-307e76e9-556f-4ec4-8661-d5bb3eee0886 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048541 Apr 14 18:50:06 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 90/278] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:50:06 2023] GET /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 18:50:06 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:50:06 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:50:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:06 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Going to try to terminate instance {{(pid=61674) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 18:50:06 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6" status: 204 len: 0 microversion: 2.1 time: 0.166470 Apr 14 18:50:06 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 96/279] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 18:50:06 2023] DELETE /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 18:50:06 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-ceef24c5-bf70-43ff-972a-721525538c85 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:50:06 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-ceef24c5-bf70-43ff-972a-721525538c85 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:50:06 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ceef24c5-bf70-43ff-972a-721525538c85 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:06 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ceef24c5-bf70-43ff-972a-721525538c85 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:06 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ceef24c5-bf70-43ff-972a-721525538c85 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:06 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ceef24c5-bf70-43ff-972a-721525538c85 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:06 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ceef24c5-bf70-43ff-972a-721525538c85 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:06 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ceef24c5-bf70-43ff-972a-721525538c85 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:07 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-ecf26ef7-de89-4c8d-b26d-ee72f0b4fb3a req-cf9edd10-11f1-4b60-9f6b-b5de93dce8d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e03adca9-8b0c-416c-943e-7dce251547c6", "name": "network-vif-unplugged", "status": "completed", "tag": "fd4a0af3-b371-4b85-8a45-3b68d9884358"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:07 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-ecf26ef7-de89-4c8d-b26d-ee72f0b4fb3a req-cf9edd10-11f1-4b60-9f6b-b5de93dce8d8 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:07 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-ecf26ef7-de89-4c8d-b26d-ee72f0b4fb3a req-cf9edd10-11f1-4b60-9f6b-b5de93dce8d8 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:07 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-ecf26ef7-de89-4c8d-b26d-ee72f0b4fb3a req-cf9edd10-11f1-4b60-9f6b-b5de93dce8d8 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:07 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-ecf26ef7-de89-4c8d-b26d-ee72f0b4fb3a req-cf9edd10-11f1-4b60-9f6b-b5de93dce8d8 service nova] Creating event network-vif-unplugged:fd4a0af3-b371-4b85-8a45-3b68d9884358 for instance e03adca9-8b0c-416c-943e-7dce251547c6 on user Apr 14 18:50:07 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-ceef24c5-bf70-43ff-972a-721525538c85 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb40ab30d44d5ebd26c3956b6d7e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418926b6689d48e3b7288ce32834dc93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:50:07 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-ecf26ef7-de89-4c8d-b26d-ee72f0b4fb3a req-cf9edd10-11f1-4b60-9f6b-b5de93dce8d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066886 Apr 14 18:50:07 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 91/280] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:50:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:50:07 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-ceef24c5-bf70-43ff-972a-721525538c85 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6" status: 200 len: 1648 microversion: 2.1 time: 0.770553 Apr 14 18:50:07 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 94/281] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:50:06 2023] GET /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6 => generated 1648 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:50:07 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-68edd181-80d8-4093-9090-e57b865e9e7f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:50:07 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-68edd181-80d8-4093-9090-e57b865e9e7f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:50:07 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-68edd181-80d8-4093-9090-e57b865e9e7f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:07 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-68edd181-80d8-4093-9090-e57b865e9e7f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:07 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-68edd181-80d8-4093-9090-e57b865e9e7f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:07 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-68edd181-80d8-4093-9090-e57b865e9e7f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:07 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-68edd181-80d8-4093-9090-e57b865e9e7f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:07 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-68edd181-80d8-4093-9090-e57b865e9e7f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:07 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-68edd181-80d8-4093-9090-e57b865e9e7f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/ips" status: 200 len: 107 microversion: 2.1 time: 0.053895 Apr 14 18:50:07 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 97/282] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 18:50:07 2023] GET /compute/v2.1/servers/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/ips => generated 107 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:50:08 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-ef7a943d-e44c-4e13-b22d-78a93446ab69 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8000d5a4-c39b-41b5-a47c-0f83b55fa0ab"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:08 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-ef7a943d-e44c-4e13-b22d-78a93446ab69 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:50:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ef7a943d-e44c-4e13-b22d-78a93446ab69 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ef7a943d-e44c-4e13-b22d-78a93446ab69 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ef7a943d-e44c-4e13-b22d-78a93446ab69 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ef7a943d-e44c-4e13-b22d-78a93446ab69 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ef7a943d-e44c-4e13-b22d-78a93446ab69 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ef7a943d-e44c-4e13-b22d-78a93446ab69 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:08 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-ef7a943d-e44c-4e13-b22d-78a93446ab69 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] HTTP exception thrown: Invalid volume: volume 8000d5a4-c39b-41b5-a47c-0f83b55fa0ab is already attached to instances: 094a4a33-569e-4137-8798-743499f1046c Apr 14 18:50:08 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-ef7a943d-e44c-4e13-b22d-78a93446ab69 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Request method failure captured: Apr 14 18:50:08 user devstack@n-api.service[61673]: request: POST /compute/v2.1/servers/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/os-volume_attachments HTTP/1.1 Apr 14 18:50:08 user devstack@n-api.service[61673]: Accept: application/json Apr 14 18:50:08 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 18:50:08 user devstack@n-api.service[61673]: Connection: close Apr 14 18:50:08 user devstack@n-api.service[61673]: Content-Length: 74 Apr 14 18:50:08 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 18:50:08 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 18:50:08 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 18:50:08 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 18:50:08 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOZ9mXKmSeVaIS46ajndcD0QEVOAAeNy4LVRU6htix22YmE3w_WsO57Wi55e6NRGyVz084DhOrXI8Tp0cfqtkOuptABoiofobC3zYryQ5y6CuXjmj_BNK8q3Ywj-icF3eYh62IR4e0eJMk7NufTqqWbSFQxNccWUoyS1F1P0cbefqlTY Apr 14 18:50:08 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 18:50:08 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 18:50:08 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 18:50:08 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 18:50:08 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 18:50:08 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 18:50:08 user devstack@n-api.service[61673]: X-Project-Id: e34cdebcd7154988a957deae140e8eab Apr 14 18:50:08 user devstack@n-api.service[61673]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 18:50:08 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 18:50:08 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 18:50:08 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:50:08 user devstack@n-api.service[61673]: X-Tenant: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 18:50:08 user devstack@n-api.service[61673]: X-Tenant-Id: e34cdebcd7154988a957deae140e8eab Apr 14 18:50:08 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 18:50:08 user devstack@n-api.service[61673]: X-User: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 18:50:08 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 18:50:08 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 18:50:08 user devstack@n-api.service[61673]: X-User-Id: 8d53edaffb8f4038abd366d7942c6bc7 Apr 14 18:50:08 user devstack@n-api.service[61673]: X-User-Name: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 18:50:08 user devstack@n-api.service[61673]: Apr 14 18:50:08 user devstack@n-api.service[61673]: {"volumeAttachment": {"volumeId": "8000d5a4-c39b-41b5-a47c-0f83b55fa0ab"}} Apr 14 18:50:08 user devstack@n-api.service[61673]: method: > Apr 14 18:50:08 user devstack@n-api.service[61673]: exception: Invalid volume: volume 8000d5a4-c39b-41b5-a47c-0f83b55fa0ab is already attached to instances: 094a4a33-569e-4137-8798-743499f1046c Apr 14 18:50:08 user devstack@n-api.service[61673]: action_args: {'server_id': 'a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9', 'body': {'volumeAttachment': {'volumeId': '8000d5a4-c39b-41b5-a47c-0f83b55fa0ab'}}} Apr 14 18:50:08 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8000d5a4-c39b-41b5-a47c-0f83b55fa0ab is already attached to instances: 094a4a33-569e-4137-8798-743499f1046c Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8000d5a4-c39b-41b5-a47c-0f83b55fa0ab is already attached to instances: 094a4a33-569e-4137-8798-743499f1046c Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8000d5a4-c39b-41b5-a47c-0f83b55fa0ab is already attached to instances: 094a4a33-569e-4137-8798-743499f1046c Apr 14 18:50:08 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:50:08 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-ef7a943d-e44c-4e13-b22d-78a93446ab69 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Returning 400 to user: Invalid volume: volume 8000d5a4-c39b-41b5-a47c-0f83b55fa0ab is already attached to instances: 094a4a33-569e-4137-8798-743499f1046c {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:50:08 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-ef7a943d-e44c-4e13-b22d-78a93446ab69 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.121933 Apr 14 18:50:08 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 92/283] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 18:50:07 2023] POST /compute/v2.1/servers/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/os-volume_attachments => generated 174 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 18:50:08 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:50:08 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:50:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:08 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Going to try to terminate instance {{(pid=61675) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 18:50:08 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9" status: 204 len: 0 microversion: 2.1 time: 0.180425 Apr 14 18:50:08 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 95/284] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 18:50:08 2023] DELETE /compute/v2.1/servers/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 18:50:08 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-31fb243e-153d-45d9-b155-8c47679af2ff tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:50:08 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-31fb243e-153d-45d9-b155-8c47679af2ff tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:50:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-31fb243e-153d-45d9-b155-8c47679af2ff tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-31fb243e-153d-45d9-b155-8c47679af2ff tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-31fb243e-153d-45d9-b155-8c47679af2ff tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-31fb243e-153d-45d9-b155-8c47679af2ff tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-31fb243e-153d-45d9-b155-8c47679af2ff tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-31fb243e-153d-45d9-b155-8c47679af2ff tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:08 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-31fb243e-153d-45d9-b155-8c47679af2ff tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d53edaffb8f4038abd366d7942c6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34cdebcd7154988a957deae140e8eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:50:08 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-31fb243e-153d-45d9-b155-8c47679af2ff tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9" status: 200 len: 1549 microversion: 2.1 time: 0.309326 Apr 14 18:50:08 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 98/285] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:50:08 2023] GET /compute/v2.1/servers/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 => generated 1549 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:50:08 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-78a09c53-5a23-4a52-9be1-d0354c8519e6 req-f420ae36-b867-4930-9fab-110948cb4b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9", "name": "network-vif-unplugged", "status": "completed", "tag": "c5adcd6e-6277-40d5-8d78-4df9155319ba"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-78a09c53-5a23-4a52-9be1-d0354c8519e6 req-f420ae36-b867-4930-9fab-110948cb4b98 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-78a09c53-5a23-4a52-9be1-d0354c8519e6 req-f420ae36-b867-4930-9fab-110948cb4b98 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-78a09c53-5a23-4a52-9be1-d0354c8519e6 req-f420ae36-b867-4930-9fab-110948cb4b98 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:08 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-78a09c53-5a23-4a52-9be1-d0354c8519e6 req-f420ae36-b867-4930-9fab-110948cb4b98 service nova] Creating event network-vif-unplugged:c5adcd6e-6277-40d5-8d78-4df9155319ba for instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 on user Apr 14 18:50:08 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-78a09c53-5a23-4a52-9be1-d0354c8519e6 req-f420ae36-b867-4930-9fab-110948cb4b98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038032 Apr 14 18:50:08 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 93/286] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:50:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:50:09 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "6e8245ec-8367-4bce-99df-352eae7f4ed7"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:09 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:50:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:09 user devstack@n-api.service[61675]: DEBUG nova.objects.instance [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lazy-loading 'flavor' on Instance uuid 8e55c721-9fad-4478-9e74-e87d0c95bc3c {{(pid=61675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 18:50:09 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c/action" status: 200 len: 29 microversion: 2.1 time: 0.492848 Apr 14 18:50:09 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 96/287] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 18:50:09 2023] POST /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c/action => generated 29 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 18:50:09 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-99f0f79a-f23c-4b20-bcf0-828f8af2dd6a tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:50:09 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-99f0f79a-f23c-4b20-bcf0-828f8af2dd6a tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:50:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-99f0f79a-f23c-4b20-bcf0-828f8af2dd6a tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-99f0f79a-f23c-4b20-bcf0-828f8af2dd6a tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-99f0f79a-f23c-4b20-bcf0-828f8af2dd6a tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-99f0f79a-f23c-4b20-bcf0-828f8af2dd6a tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-99f0f79a-f23c-4b20-bcf0-828f8af2dd6a tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-99f0f79a-f23c-4b20-bcf0-828f8af2dd6a tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:09 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-8b25baa0-5bb4-4421-ac24-997a2825e7b8 req-452c991a-de3c-4c6c-999a-08edad7e4cff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9", "tag": "c5adcd6e-6277-40d5-8d78-4df9155319ba"}, {"server_uuid": "e03adca9-8b0c-416c-943e-7dce251547c6", "name": "network-vif-plugged", "status": "completed", "tag": "fd4a0af3-b371-4b85-8a45-3b68d9884358"}, {"server_uuid": "e03adca9-8b0c-416c-943e-7dce251547c6", "name": "network-vif-deleted", "tag": "fd4a0af3-b371-4b85-8a45-3b68d9884358"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:09 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-8b25baa0-5bb4-4421-ac24-997a2825e7b8 req-452c991a-de3c-4c6c-999a-08edad7e4cff service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:09 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-8b25baa0-5bb4-4421-ac24-997a2825e7b8 req-452c991a-de3c-4c6c-999a-08edad7e4cff service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:09 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-8b25baa0-5bb4-4421-ac24-997a2825e7b8 req-452c991a-de3c-4c6c-999a-08edad7e4cff service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:09 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-8b25baa0-5bb4-4421-ac24-997a2825e7b8 req-452c991a-de3c-4c6c-999a-08edad7e4cff service nova] Creating event network-changed:c5adcd6e-6277-40d5-8d78-4df9155319ba for instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 on user Apr 14 18:50:09 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-8b25baa0-5bb4-4421-ac24-997a2825e7b8 req-452c991a-de3c-4c6c-999a-08edad7e4cff service nova] Creating event network-vif-plugged:fd4a0af3-b371-4b85-8a45-3b68d9884358 for instance e03adca9-8b0c-416c-943e-7dce251547c6 on user Apr 14 18:50:09 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-8b25baa0-5bb4-4421-ac24-997a2825e7b8 req-452c991a-de3c-4c6c-999a-08edad7e4cff service nova] Creating event network-vif-deleted:fd4a0af3-b371-4b85-8a45-3b68d9884358 for instance e03adca9-8b0c-416c-943e-7dce251547c6 on user Apr 14 18:50:09 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-8b25baa0-5bb4-4421-ac24-997a2825e7b8 req-452c991a-de3c-4c6c-999a-08edad7e4cff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.052126 Apr 14 18:50:09 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 94/288] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:50:09 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:50:10 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-99f0f79a-f23c-4b20-bcf0-828f8af2dd6a tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ed7885e7774691b02c19cf08c2177f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d84c59848f445a90eb7eab6be04253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:50:10 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-99f0f79a-f23c-4b20-bcf0-828f8af2dd6a tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c" status: 200 len: 1725 microversion: 2.1 time: 0.814737 Apr 14 18:50:10 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 99/289] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:50:09 2023] GET /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c => generated 1725 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:50:11 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-999f6cd6-7225-411f-b9d2-324419c63d57 req-1031f229-d68f-4d3e-b349-ed8e630d919e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9", "name": "network-vif-plugged", "status": "completed", "tag": "c5adcd6e-6277-40d5-8d78-4df9155319ba"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-999f6cd6-7225-411f-b9d2-324419c63d57 req-1031f229-d68f-4d3e-b349-ed8e630d919e service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-999f6cd6-7225-411f-b9d2-324419c63d57 req-1031f229-d68f-4d3e-b349-ed8e630d919e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-999f6cd6-7225-411f-b9d2-324419c63d57 req-1031f229-d68f-4d3e-b349-ed8e630d919e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:11 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-999f6cd6-7225-411f-b9d2-324419c63d57 req-1031f229-d68f-4d3e-b349-ed8e630d919e service nova] Creating event network-vif-plugged:c5adcd6e-6277-40d5-8d78-4df9155319ba for instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 on user Apr 14 18:50:11 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-999f6cd6-7225-411f-b9d2-324419c63d57 req-1031f229-d68f-4d3e-b349-ed8e630d919e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042927 Apr 14 18:50:11 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 97/290] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:50:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:50:11 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-10aadb87-0327-4cde-8b40-3ec529611bd2 req-fa781979-1acd-41b1-9792-56e3c19bfecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9", "name": "network-vif-deleted", "tag": "c5adcd6e-6277-40d5-8d78-4df9155319ba"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:11 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-10aadb87-0327-4cde-8b40-3ec529611bd2 req-fa781979-1acd-41b1-9792-56e3c19bfecd service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:11 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-10aadb87-0327-4cde-8b40-3ec529611bd2 req-fa781979-1acd-41b1-9792-56e3c19bfecd service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:11 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-10aadb87-0327-4cde-8b40-3ec529611bd2 req-fa781979-1acd-41b1-9792-56e3c19bfecd service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:11 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-10aadb87-0327-4cde-8b40-3ec529611bd2 req-fa781979-1acd-41b1-9792-56e3c19bfecd service nova] Creating event network-vif-deleted:c5adcd6e-6277-40d5-8d78-4df9155319ba for instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 on user Apr 14 18:50:11 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-10aadb87-0327-4cde-8b40-3ec529611bd2 req-fa781979-1acd-41b1-9792-56e3c19bfecd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031605 Apr 14 18:50:11 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 95/291] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:50:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:50:11 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-fd87f424-51ac-4152-87c5-7a8528dac25f req-97795772-0900-4792-b0fa-7f845f40950c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e55c721-9fad-4478-9e74-e87d0c95bc3c", "name": "network-vif-unplugged", "status": "completed", "tag": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-fd87f424-51ac-4152-87c5-7a8528dac25f req-97795772-0900-4792-b0fa-7f845f40950c service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-fd87f424-51ac-4152-87c5-7a8528dac25f req-97795772-0900-4792-b0fa-7f845f40950c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-fd87f424-51ac-4152-87c5-7a8528dac25f req-97795772-0900-4792-b0fa-7f845f40950c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:12 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-fd87f424-51ac-4152-87c5-7a8528dac25f req-97795772-0900-4792-b0fa-7f845f40950c service nova] Creating event network-vif-unplugged:66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c on user Apr 14 18:50:12 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-fd87f424-51ac-4152-87c5-7a8528dac25f req-97795772-0900-4792-b0fa-7f845f40950c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029907 Apr 14 18:50:12 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 100/292] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:50:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 18:50:13 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-db3b2d09-55fa-4776-8c54-6b1777355833 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:50:13 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-db3b2d09-55fa-4776-8c54-6b1777355833 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:50:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-db3b2d09-55fa-4776-8c54-6b1777355833 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-db3b2d09-55fa-4776-8c54-6b1777355833 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-db3b2d09-55fa-4776-8c54-6b1777355833 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-db3b2d09-55fa-4776-8c54-6b1777355833 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-db3b2d09-55fa-4776-8c54-6b1777355833 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-db3b2d09-55fa-4776-8c54-6b1777355833 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:13 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-db3b2d09-55fa-4776-8c54-6b1777355833 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:50:13 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-db3b2d09-55fa-4776-8c54-6b1777355833 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 200 len: 1721 microversion: 2.1 time: 0.284038 Apr 14 18:50:13 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 98/293] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:50:13 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 1721 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:50:14 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-c20fbecf-f00f-4329-bdde-91e6d68a00d6 req-d65673f3-c2d5-4406-b80d-35d655948e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e55c721-9fad-4478-9e74-e87d0c95bc3c", "name": "network-vif-plugged", "status": "completed", "tag": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-c20fbecf-f00f-4329-bdde-91e6d68a00d6 req-d65673f3-c2d5-4406-b80d-35d655948e27 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-c20fbecf-f00f-4329-bdde-91e6d68a00d6 req-d65673f3-c2d5-4406-b80d-35d655948e27 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-c20fbecf-f00f-4329-bdde-91e6d68a00d6 req-d65673f3-c2d5-4406-b80d-35d655948e27 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:14 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-c20fbecf-f00f-4329-bdde-91e6d68a00d6 req-d65673f3-c2d5-4406-b80d-35d655948e27 service nova] Creating event network-vif-plugged:66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c on user Apr 14 18:50:14 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-c20fbecf-f00f-4329-bdde-91e6d68a00d6 req-d65673f3-c2d5-4406-b80d-35d655948e27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030876 Apr 14 18:50:14 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 96/294] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:50:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:50:16 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-d314f2b7-610a-449e-966b-b0f76d01cf67 req-8ba894dc-41cb-4ebd-a105-a4a976698e5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e55c721-9fad-4478-9e74-e87d0c95bc3c", "name": "network-vif-plugged", "status": "completed", "tag": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-d314f2b7-610a-449e-966b-b0f76d01cf67 req-8ba894dc-41cb-4ebd-a105-a4a976698e5a service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-d314f2b7-610a-449e-966b-b0f76d01cf67 req-8ba894dc-41cb-4ebd-a105-a4a976698e5a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-d314f2b7-610a-449e-966b-b0f76d01cf67 req-8ba894dc-41cb-4ebd-a105-a4a976698e5a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:16 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-d314f2b7-610a-449e-966b-b0f76d01cf67 req-8ba894dc-41cb-4ebd-a105-a4a976698e5a service nova] Creating event network-vif-plugged:66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c on user Apr 14 18:50:16 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-d314f2b7-610a-449e-966b-b0f76d01cf67 req-8ba894dc-41cb-4ebd-a105-a4a976698e5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046128 Apr 14 18:50:16 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 101/295] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:50:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:50:18 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-3d298541-d1b8-441f-a195-7e41aacade33 req-4df1851b-0438-404a-8127-79e1b12681ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e55c721-9fad-4478-9e74-e87d0c95bc3c", "name": "network-vif-plugged", "status": "completed", "tag": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:18 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-3d298541-d1b8-441f-a195-7e41aacade33 req-4df1851b-0438-404a-8127-79e1b12681ee service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:18 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-3d298541-d1b8-441f-a195-7e41aacade33 req-4df1851b-0438-404a-8127-79e1b12681ee service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:18 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-3d298541-d1b8-441f-a195-7e41aacade33 req-4df1851b-0438-404a-8127-79e1b12681ee service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:18 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-3d298541-d1b8-441f-a195-7e41aacade33 req-4df1851b-0438-404a-8127-79e1b12681ee service nova] Creating event network-vif-plugged:66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c on user Apr 14 18:50:18 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-3d298541-d1b8-441f-a195-7e41aacade33 req-4df1851b-0438-404a-8127-79e1b12681ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031899 Apr 14 18:50:18 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 99/296] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:50:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:50:19 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-4b88e7e1-458f-4f0c-87bb-d2f3b84f8adc tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:50:19 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-4b88e7e1-458f-4f0c-87bb-d2f3b84f8adc tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:50:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4b88e7e1-458f-4f0c-87bb-d2f3b84f8adc tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4b88e7e1-458f-4f0c-87bb-d2f3b84f8adc tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4b88e7e1-458f-4f0c-87bb-d2f3b84f8adc tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4b88e7e1-458f-4f0c-87bb-d2f3b84f8adc tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4b88e7e1-458f-4f0c-87bb-d2f3b84f8adc tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4b88e7e1-458f-4f0c-87bb-d2f3b84f8adc tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:20 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-4b88e7e1-458f-4f0c-87bb-d2f3b84f8adc tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e1d31c2d9048699758779dedf7d3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6b4e98cf9e4f96b79c3288dfe0da89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:50:20 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-4b88e7e1-458f-4f0c-87bb-d2f3b84f8adc tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae" status: 200 len: 1748 microversion: 2.1 time: 0.536357 Apr 14 18:50:20 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 97/297] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:50:19 2023] GET /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae => generated 1748 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:50:20 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2104481497", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:20 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-936f49f9-aa06-4dc9-bf2a-169c94307d8e tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:50:20 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-936f49f9-aa06-4dc9-bf2a-169c94307d8e tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:50:20 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-936f49f9-aa06-4dc9-bf2a-169c94307d8e tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:20 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-936f49f9-aa06-4dc9-bf2a-169c94307d8e tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:20 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-936f49f9-aa06-4dc9-bf2a-169c94307d8e tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:20 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-936f49f9-aa06-4dc9-bf2a-169c94307d8e tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:20 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-936f49f9-aa06-4dc9-bf2a-169c94307d8e tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:20 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-936f49f9-aa06-4dc9-bf2a-169c94307d8e tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:20 user devstack@n-api.service[61674]: DEBUG nova.network.neutron [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] validate_networks() for [('fc7fb9bf-ad17-4427-9165-d2b68830357a', None, None, None, None, None)] {{(pid=61674) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:50:21 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-936f49f9-aa06-4dc9-bf2a-169c94307d8e tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f78850ecd8042dbac5f24113b9df70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22a362d9cb946a99c203366f88baafb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:50:21 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-936f49f9-aa06-4dc9-bf2a-169c94307d8e tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/482b8c77-c963-4bc1-8e3c-847650736767" status: 200 len: 1493 microversion: 2.1 time: 0.780598 Apr 14 18:50:21 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 100/298] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:50:20 2023] GET /compute/v2.1/servers/482b8c77-c963-4bc1-8e3c-847650736767 => generated 1493 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:50:21 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Flavor limits 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:50:21 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Image limits 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:50:21 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Flavor pref 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:50:21 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Image pref 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:50:21 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:50:21 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:21 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:21 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:21 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:21 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:21 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:21 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Getting quotas for project e60e8abd123e414f847c68ba72894689. Resources: {'ram', 'instances', 'cores'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:50:21 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Getting quotas for user c8713ed85ffb4446847f5ded4bc2e399 and project e60e8abd123e414f847c68ba72894689. Resources: {'ram', 'instances', 'cores'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:50:21 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Going to run 1 instances... {{(pid=61674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:50:21 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:50:21 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.521302 Apr 14 18:50:21 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 102/299] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:50:20 2023] POST /compute/v2.1/servers => generated 381 bytes in 1525 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:50:22 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-2a7ab28b-758a-448b-95c1-3877ae56ee16 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:50:22 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-2a7ab28b-758a-448b-95c1-3877ae56ee16 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:50:22 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-2a7ab28b-758a-448b-95c1-3877ae56ee16 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8713ed85ffb4446847f5ded4bc2e399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60e8abd123e414f847c68ba72894689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:50:22 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-2a7ab28b-758a-448b-95c1-3877ae56ee16 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d305ab4-1813-4728-a01c-287e521a05ec" status: 200 len: 1216 microversion: 2.1 time: 0.095808 Apr 14 18:50:22 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 98/300] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:50:22 2023] GET /compute/v2.1/servers/1d305ab4-1813-4728-a01c-287e521a05ec => generated 1216 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:50:22 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-502749594", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:22 user devstack@n-api.service[61675]: DEBUG nova.network.neutron [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] validate_networks() for [('fc7fb9bf-ad17-4427-9165-d2b68830357a', None, None, None, None, None)] {{(pid=61675) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:50:22 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Flavor limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:50:22 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Image limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:50:22 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Flavor pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:50:22 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Image pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:50:22 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:50:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:22 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Getting quotas for project e60e8abd123e414f847c68ba72894689. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:50:22 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Getting quotas for user c8713ed85ffb4446847f5ded4bc2e399 and project e60e8abd123e414f847c68ba72894689. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:50:22 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Going to run 1 instances... {{(pid=61675) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:50:22 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:50:22 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.563232 Apr 14 18:50:22 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 101/301] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:50:22 2023] POST /compute/v2.1/servers => generated 381 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:50:22 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-b5876a88-13fc-4ccf-b6c0-6fd82edb9ae6 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:50:22 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-b5876a88-13fc-4ccf-b6c0-6fd82edb9ae6 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:50:22 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-b5876a88-13fc-4ccf-b6c0-6fd82edb9ae6 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8713ed85ffb4446847f5ded4bc2e399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60e8abd123e414f847c68ba72894689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:50:22 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-b5876a88-13fc-4ccf-b6c0-6fd82edb9ae6 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf640f3e-3d77-46ee-8a11-e0bdc870ff97" status: 200 len: 1215 microversion: 2.1 time: 0.101992 Apr 14 18:50:22 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 103/302] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:50:22 2023] GET /compute/v2.1/servers/cf640f3e-3d77-46ee-8a11-e0bdc870ff97 => generated 1215 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:50:27 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-48dbab0b-aecc-4696-978a-079928bb392f req-5f01749e-1bfd-4eee-86a2-e13eaf7dd656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d305ab4-1813-4728-a01c-287e521a05ec", "tag": "d07ff847-3983-4b35-af36-fbd845ede770"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:27 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-48dbab0b-aecc-4696-978a-079928bb392f req-5f01749e-1bfd-4eee-86a2-e13eaf7dd656 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:27 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-48dbab0b-aecc-4696-978a-079928bb392f req-5f01749e-1bfd-4eee-86a2-e13eaf7dd656 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:27 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-48dbab0b-aecc-4696-978a-079928bb392f req-5f01749e-1bfd-4eee-86a2-e13eaf7dd656 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:27 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-48dbab0b-aecc-4696-978a-079928bb392f req-5f01749e-1bfd-4eee-86a2-e13eaf7dd656 service nova] Creating event network-changed:d07ff847-3983-4b35-af36-fbd845ede770 for instance 1d305ab4-1813-4728-a01c-287e521a05ec on user Apr 14 18:50:27 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-48dbab0b-aecc-4696-978a-079928bb392f req-5f01749e-1bfd-4eee-86a2-e13eaf7dd656 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029123 Apr 14 18:50:27 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 99/303] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:50:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:50:28 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-da0c380f-216c-4a3d-8cbc-1a1b91fb2771 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Action: 'create', calling method: .version_select at 0x7fdae146f370>, body: {"keypair": {"name": "tempest-keypair-1346818342", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC137Xf3AnF1rNtIhwlNVYT522UpBbMSfFdG6x9R8uAHDX1y4mjdFVLuE4+V7JiMD4jkchT1K4wNrq2r/rMuPGS+e3iEX6He8rTuPweC7QQlcmkQV4D2K0Puqu4A57IOrA=="}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:28 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-da0c380f-216c-4a3d-8cbc-1a1b91fb2771 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Getting quotas for project 5c49bffa4d8e4f92a54ad17a5f5db634. Resources: {'key_pairs'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:50:28 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-da0c380f-216c-4a3d-8cbc-1a1b91fb2771 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Getting quotas for user 9ee19795311144e69dd00db0403cb8b1 and project 5c49bffa4d8e4f92a54ad17a5f5db634. Resources: {'key_pairs'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:50:28 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-da0c380f-216c-4a3d-8cbc-1a1b91fb2771 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.087080 Apr 14 18:50:28 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 102/304] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 18:50:28 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 91 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 18:50:29 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-808ffd86-84b2-4312-bfb3-3a04e5c32349 req-d9d979e5-dda1-42ba-9bf9-3e811ab655f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf640f3e-3d77-46ee-8a11-e0bdc870ff97", "tag": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-808ffd86-84b2-4312-bfb3-3a04e5c32349 req-d9d979e5-dda1-42ba-9bf9-3e811ab655f8 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-808ffd86-84b2-4312-bfb3-3a04e5c32349 req-d9d979e5-dda1-42ba-9bf9-3e811ab655f8 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-808ffd86-84b2-4312-bfb3-3a04e5c32349 req-d9d979e5-dda1-42ba-9bf9-3e811ab655f8 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:29 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-808ffd86-84b2-4312-bfb3-3a04e5c32349 req-d9d979e5-dda1-42ba-9bf9-3e811ab655f8 service nova] Creating event network-changed:ee0e2f74-c744-41ec-b3f8-c7d124c61f8e for instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 on user Apr 14 18:50:29 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-808ffd86-84b2-4312-bfb3-3a04e5c32349 req-d9d979e5-dda1-42ba-9bf9-3e811ab655f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041346 Apr 14 18:50:29 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 104/305] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:50:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:50:29 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-991cc3a4-dc15-4156-9f3d-b8b479dbb7d4 req-6125defd-422a-45a5-845b-3b400fb5d6ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d305ab4-1813-4728-a01c-287e521a05ec", "name": "network-vif-plugged", "status": "completed", "tag": "d07ff847-3983-4b35-af36-fbd845ede770"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-991cc3a4-dc15-4156-9f3d-b8b479dbb7d4 req-6125defd-422a-45a5-845b-3b400fb5d6ac service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-991cc3a4-dc15-4156-9f3d-b8b479dbb7d4 req-6125defd-422a-45a5-845b-3b400fb5d6ac service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-991cc3a4-dc15-4156-9f3d-b8b479dbb7d4 req-6125defd-422a-45a5-845b-3b400fb5d6ac service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:29 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-991cc3a4-dc15-4156-9f3d-b8b479dbb7d4 req-6125defd-422a-45a5-845b-3b400fb5d6ac service nova] Creating event network-vif-plugged:d07ff847-3983-4b35-af36-fbd845ede770 for instance 1d305ab4-1813-4728-a01c-287e521a05ec on user Apr 14 18:50:29 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-991cc3a4-dc15-4156-9f3d-b8b479dbb7d4 req-6125defd-422a-45a5-845b-3b400fb5d6ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059171 Apr 14 18:50:29 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 100/306] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:50:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:50:29 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-750671987", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "6508b35e-2e3c-4d6a-8952-0176e7be3891"}, {"port": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "tag": "port-1"}, {"port": "f4fbff28-9aec-444f-aef4-a67e882a9255", "tag": "port-2"}, {"uuid": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "tag": "net-1"}, {"uuid": "af7faac4-eb43-4442-bc1b-5846ff21f36f"}, {"uuid": "958931d7-a1a9-4a23-b950-7180df8d7edc", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "958931d7-a1a9-4a23-b950-7180df8d7edc", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "ba800019-a4b5-415c-8525-6059d9336490", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "a1039149-f70d-4abd-a8fa-48767f099f90", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1167293559"}], "key_name": "tempest-keypair-1346818342", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:30 user devstack@n-api.service[61675]: DEBUG nova.network.neutron [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] validate_networks() for [('6508b35e-2e3c-4d6a-8952-0176e7be3891', None, None, None, None, None), (None, None, '2af029d9-055b-406b-a82d-a88d8b51c4fa', None, None, None), (None, None, 'f4fbff28-9aec-444f-aef4-a67e882a9255', None, None, None), ('af7faac4-eb43-4442-bc1b-5846ff21f36f', None, None, None, None, None), ('af7faac4-eb43-4442-bc1b-5846ff21f36f', None, None, None, None, None), ('958931d7-a1a9-4a23-b950-7180df8d7edc', '10.2.2.100', None, None, None, None), ('958931d7-a1a9-4a23-b950-7180df8d7edc', '10.2.2.200', None, None, None, None)] {{(pid=61675) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:50:32 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-e3694f08-d5ac-43c6-900a-919a6a123089 req-35771361-0183-412a-89b3-b7ed641b9a10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d305ab4-1813-4728-a01c-287e521a05ec", "name": "network-vif-plugged", "status": "completed", "tag": "d07ff847-3983-4b35-af36-fbd845ede770"}, {"server_uuid": "cf640f3e-3d77-46ee-8a11-e0bdc870ff97", "name": "network-vif-plugged", "status": "completed", "tag": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e"}, {"server_uuid": "cf640f3e-3d77-46ee-8a11-e0bdc870ff97", "name": "network-vif-plugged", "status": "completed", "tag": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:32 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:50:32 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:50:32 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-e3694f08-d5ac-43c6-900a-919a6a123089 req-35771361-0183-412a-89b3-b7ed641b9a10 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:32 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-e3694f08-d5ac-43c6-900a-919a6a123089 req-35771361-0183-412a-89b3-b7ed641b9a10 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:32 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-e3694f08-d5ac-43c6-900a-919a6a123089 req-35771361-0183-412a-89b3-b7ed641b9a10 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:32 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:50:32 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-e3694f08-d5ac-43c6-900a-919a6a123089 req-35771361-0183-412a-89b3-b7ed641b9a10 service nova] Creating event network-vif-plugged:d07ff847-3983-4b35-af36-fbd845ede770 for instance 1d305ab4-1813-4728-a01c-287e521a05ec on user Apr 14 18:50:32 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-e3694f08-d5ac-43c6-900a-919a6a123089 req-35771361-0183-412a-89b3-b7ed641b9a10 service nova] Creating event network-vif-plugged:ee0e2f74-c744-41ec-b3f8-c7d124c61f8e for instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 on user Apr 14 18:50:32 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-e3694f08-d5ac-43c6-900a-919a6a123089 req-35771361-0183-412a-89b3-b7ed641b9a10 service nova] Creating event network-vif-plugged:ee0e2f74-c744-41ec-b3f8-c7d124c61f8e for instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 on user Apr 14 18:50:32 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-e3694f08-d5ac-43c6-900a-919a6a123089 req-35771361-0183-412a-89b3-b7ed641b9a10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.055157 Apr 14 18:50:32 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 105/307] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:50:32 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:50:32 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:50:32 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:50:33 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Flavor limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:50:33 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Image limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:50:33 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Flavor pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:50:33 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Image pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:50:33 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:50:33 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:33 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:33 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:33 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:33 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:33 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:33 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Getting quotas for project 5c49bffa4d8e4f92a54ad17a5f5db634. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:50:33 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Getting quotas for user 9ee19795311144e69dd00db0403cb8b1 and project 5c49bffa4d8e4f92a54ad17a5f5db634. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:50:33 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Going to run 1 instances... {{(pid=61675) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:50:33 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='ba800019-a4b5-415c-8525-6059d9336490',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a1039149-f70d-4abd-a8fa-48767f099f90',volume_size=None,volume_type=None)] {{(pid=61675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:50:33 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:50:33 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-7cefcd86-1f76-49a9-87af-f97ad276e435 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:50:33 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-7cefcd86-1f76-49a9-87af-f97ad276e435 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:50:33 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-7cefcd86-1f76-49a9-87af-f97ad276e435 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:33 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-7cefcd86-1f76-49a9-87af-f97ad276e435 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:33 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-7cefcd86-1f76-49a9-87af-f97ad276e435 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:33 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-7cefcd86-1f76-49a9-87af-f97ad276e435 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:33 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-7cefcd86-1f76-49a9-87af-f97ad276e435 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:33 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-7cefcd86-1f76-49a9-87af-f97ad276e435 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:33 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-7cefcd86-1f76-49a9-87af-f97ad276e435 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] HTTP exception thrown: Instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 could not be found. Apr 14 18:50:33 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-7cefcd86-1f76-49a9-87af-f97ad276e435 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Request method failure captured: Apr 14 18:50:33 user devstack@n-api.service[61673]: request: GET /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 HTTP/1.1 Apr 14 18:50:33 user devstack@n-api.service[61673]: Accept: application/json Apr 14 18:50:33 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 18:50:33 user devstack@n-api.service[61673]: Connection: close Apr 14 18:50:33 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 18:50:33 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 18:50:33 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 18:50:33 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 18:50:33 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 18:50:33 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOZ9v7WRk1IO6hE58DhwzZXUJPD9CerPThxcj9Wap5ytfpqNsYx6d0x9Ksedq-bx4VJa6Lz4zCvfIoqQCjnJhbCzfiZ3QuC5K4EfBi4Pw1Re0RX3b5gAbXik06uZLVk7EmlK3VxAV-JFPuSOu8NHIPU3EOhC94WRDUQ1pWO3I2Q-qHus Apr 14 18:50:33 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 18:50:33 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 18:50:33 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 18:50:33 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 18:50:33 user devstack@n-api.service[61673]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 18:50:33 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 18:50:33 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 18:50:33 user devstack@n-api.service[61673]: X-Project-Id: efae74f239e14c29b3af28c7fceee94d Apr 14 18:50:33 user devstack@n-api.service[61673]: X-Project-Name: tempest-TaggedAttachmentsTest-2056271432 Apr 14 18:50:33 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 18:50:33 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 18:50:33 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/efae74f239e14c29b3af28c7fceee94d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/efae74f239e14c29b3af28c7fceee94d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/efae74f239e14c29b3af28c7fceee94d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:50:33 user devstack@n-api.service[61673]: X-Tenant: tempest-TaggedAttachmentsTest-2056271432 Apr 14 18:50:33 user devstack@n-api.service[61673]: X-Tenant-Id: efae74f239e14c29b3af28c7fceee94d Apr 14 18:50:33 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-TaggedAttachmentsTest-2056271432 Apr 14 18:50:33 user devstack@n-api.service[61673]: X-User: tempest-TaggedAttachmentsTest-2056271432-project-member Apr 14 18:50:33 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 18:50:33 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 18:50:33 user devstack@n-api.service[61673]: X-User-Id: b083d961ab7546a7bb743d034c5e0815 Apr 14 18:50:33 user devstack@n-api.service[61673]: X-User-Name: tempest-TaggedAttachmentsTest-2056271432-project-member Apr 14 18:50:33 user devstack@n-api.service[61673]: method: > Apr 14 18:50:33 user devstack@n-api.service[61673]: exception: Instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 could not be found. Apr 14 18:50:33 user devstack@n-api.service[61673]: action_args: {'id': 'e3e82a4d-89b7-4bd5-8b22-f17a019e6b99'} Apr 14 18:50:33 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 could not be found. Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 could not be found. Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 could not be found. Apr 14 18:50:33 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:50:33 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-7cefcd86-1f76-49a9-87af-f97ad276e435 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Returning 404 to user: Instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:50:33 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-7cefcd86-1f76-49a9-87af-f97ad276e435 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" status: 404 len: 111 microversion: 2.49 time: 0.075961 Apr 14 18:50:33 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 101/308] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:50:33 2023] GET /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 18:50:33 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-d7929422-98d0-44f3-a59a-4d0aac4464d5 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Calling method '.version_select at 0x7fdae1148940>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:50:33 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=8 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:50:33 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-d7929422-98d0-44f3-a59a-4d0aac4464d5 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1208398939" status: 204 len: 0 microversion: 2.49 time: 0.036424 Apr 14 18:50:33 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 106/309] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 18:50:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1208398939 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 18:50:33 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 3.912460 Apr 14 18:50:33 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 103/310] 10.0.0.210 () {66 vars in 1266 bytes} [Fri Apr 14 18:50:29 2023] POST /compute/v2.1/servers => generated 404 bytes in 3914 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 18:50:33 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-a782ebb3-0d5c-44ee-9573-f4a33a5bea2e tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:50:33 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-a782ebb3-0d5c-44ee-9573-f4a33a5bea2e tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:50:34 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-a782ebb3-0d5c-44ee-9573-f4a33a5bea2e tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee19795311144e69dd00db0403cb8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c49bffa4d8e4f92a54ad17a5f5db634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:50:34 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-a782ebb3-0d5c-44ee-9573-f4a33a5bea2e tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ee19795311144e69dd00db0403cb8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c49bffa4d8e4f92a54ad17a5f5db634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:50:34 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-a782ebb3-0d5c-44ee-9573-f4a33a5bea2e tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ee19795311144e69dd00db0403cb8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c49bffa4d8e4f92a54ad17a5f5db634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:50:34 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-a782ebb3-0d5c-44ee-9573-f4a33a5bea2e tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc260db7-ffd6-4b7a-8b70-b4070478faab" status: 200 len: 1279 microversion: 2.42 time: 0.118726 Apr 14 18:50:34 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 102/311] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:50:33 2023] GET /compute/v2.1/servers/dc260db7-ffd6-4b7a-8b70-b4070478faab => generated 1279 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 18:50:36 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-3f2c9ade-0284-47c7-9706-201d55912739 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:50:36 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-3f2c9ade-0284-47c7-9706-201d55912739 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:50:36 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-3f2c9ade-0284-47c7-9706-201d55912739 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:36 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-3f2c9ade-0284-47c7-9706-201d55912739 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:36 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-3f2c9ade-0284-47c7-9706-201d55912739 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:36 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-3f2c9ade-0284-47c7-9706-201d55912739 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:36 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-3f2c9ade-0284-47c7-9706-201d55912739 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:36 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-3f2c9ade-0284-47c7-9706-201d55912739 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:36 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-3f2c9ade-0284-47c7-9706-201d55912739 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] HTTP exception thrown: Instance 2c4f47d7-95da-4a01-b6e6-eb14933fede7 could not be found. Apr 14 18:50:36 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-3f2c9ade-0284-47c7-9706-201d55912739 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Request method failure captured: Apr 14 18:50:36 user devstack@n-api.service[61674]: request: GET /compute/v2.1/servers/2c4f47d7-95da-4a01-b6e6-eb14933fede7 HTTP/1.1 Apr 14 18:50:36 user devstack@n-api.service[61674]: Accept: application/json Apr 14 18:50:36 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 18:50:36 user devstack@n-api.service[61674]: Connection: close Apr 14 18:50:36 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 18:50:36 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 18:50:36 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 18:50:36 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 18:50:36 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 18:50:36 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOZ-qH7pUgx1LyHp_evZQKZ_odKsayVUEioA7FsUb5qz5KOEXA8Q45h-O1RAk3XTjiaMAMWpEO8wz64sI5645XRskJbMTOS1Ctww3740pnmC0HZo87gVqSukUBxDnTKy45LghZkZjn_nmbep2etza8DblI_GcbcARzkVfiuA-13jLfHg Apr 14 18:50:36 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 18:50:36 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 18:50:36 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 18:50:36 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 18:50:36 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 18:50:36 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 18:50:36 user devstack@n-api.service[61674]: X-Project-Id: 95319509fb6a4e58998703975370877a Apr 14 18:50:36 user devstack@n-api.service[61674]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1033700636 Apr 14 18:50:36 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 18:50:36 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 18:50:36 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/95319509fb6a4e58998703975370877a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/95319509fb6a4e58998703975370877a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/95319509fb6a4e58998703975370877a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:50:36 user devstack@n-api.service[61674]: X-Tenant: tempest-VolumesSnapshotTestJSON-1033700636 Apr 14 18:50:36 user devstack@n-api.service[61674]: X-Tenant-Id: 95319509fb6a4e58998703975370877a Apr 14 18:50:36 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1033700636 Apr 14 18:50:36 user devstack@n-api.service[61674]: X-User: tempest-VolumesSnapshotTestJSON-1033700636-project-member Apr 14 18:50:36 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 18:50:36 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 18:50:36 user devstack@n-api.service[61674]: X-User-Id: 1f3f788e144c46e7bdf6f4fe3a5aeb79 Apr 14 18:50:36 user devstack@n-api.service[61674]: X-User-Name: tempest-VolumesSnapshotTestJSON-1033700636-project-member Apr 14 18:50:36 user devstack@n-api.service[61674]: method: > Apr 14 18:50:36 user devstack@n-api.service[61674]: exception: Instance 2c4f47d7-95da-4a01-b6e6-eb14933fede7 could not be found. Apr 14 18:50:36 user devstack@n-api.service[61674]: action_args: {'id': '2c4f47d7-95da-4a01-b6e6-eb14933fede7'} Apr 14 18:50:36 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c4f47d7-95da-4a01-b6e6-eb14933fede7 could not be found. Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c4f47d7-95da-4a01-b6e6-eb14933fede7 could not be found. Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c4f47d7-95da-4a01-b6e6-eb14933fede7 could not be found. Apr 14 18:50:36 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:50:36 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-3f2c9ade-0284-47c7-9706-201d55912739 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Returning 404 to user: Instance 2c4f47d7-95da-4a01-b6e6-eb14933fede7 could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:50:36 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-3f2c9ade-0284-47c7-9706-201d55912739 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c4f47d7-95da-4a01-b6e6-eb14933fede7" status: 404 len: 111 microversion: 2.1 time: 0.051049 Apr 14 18:50:36 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 107/312] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:50:36 2023] GET /compute/v2.1/servers/2c4f47d7-95da-4a01-b6e6-eb14933fede7 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:50:37 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-738ca09a-08a8-4c91-bf64-586171e74ae7 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:50:37 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-738ca09a-08a8-4c91-bf64-586171e74ae7 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:50:37 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:50:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-738ca09a-08a8-4c91-bf64-586171e74ae7 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-738ca09a-08a8-4c91-bf64-586171e74ae7 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-738ca09a-08a8-4c91-bf64-586171e74ae7 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-738ca09a-08a8-4c91-bf64-586171e74ae7 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-738ca09a-08a8-4c91-bf64-586171e74ae7 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-738ca09a-08a8-4c91-bf64-586171e74ae7 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:37 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-738ca09a-08a8-4c91-bf64-586171e74ae7 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] HTTP exception thrown: Instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 could not be found. Apr 14 18:50:37 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-738ca09a-08a8-4c91-bf64-586171e74ae7 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Request method failure captured: Apr 14 18:50:37 user devstack@n-api.service[61675]: request: DELETE /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 HTTP/1.1 Apr 14 18:50:37 user devstack@n-api.service[61675]: Accept: application/json Apr 14 18:50:37 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 18:50:37 user devstack@n-api.service[61675]: Connection: close Apr 14 18:50:37 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 18:50:37 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 18:50:37 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 18:50:37 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 18:50:37 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 18:50:37 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOZ9v7WRk1IO6hE58DhwzZXUJPD9CerPThxcj9Wap5ytfpqNsYx6d0x9Ksedq-bx4VJa6Lz4zCvfIoqQCjnJhbCzfiZ3QuC5K4EfBi4Pw1Re0RX3b5gAbXik06uZLVk7EmlK3VxAV-JFPuSOu8NHIPU3EOhC94WRDUQ1pWO3I2Q-qHus Apr 14 18:50:37 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 18:50:37 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 18:50:37 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 18:50:37 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 18:50:37 user devstack@n-api.service[61675]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 18:50:37 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 18:50:37 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 18:50:37 user devstack@n-api.service[61675]: X-Project-Id: efae74f239e14c29b3af28c7fceee94d Apr 14 18:50:37 user devstack@n-api.service[61675]: X-Project-Name: tempest-TaggedAttachmentsTest-2056271432 Apr 14 18:50:37 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 18:50:37 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 18:50:37 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/efae74f239e14c29b3af28c7fceee94d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/efae74f239e14c29b3af28c7fceee94d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/efae74f239e14c29b3af28c7fceee94d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:50:37 user devstack@n-api.service[61675]: X-Tenant: tempest-TaggedAttachmentsTest-2056271432 Apr 14 18:50:37 user devstack@n-api.service[61675]: X-Tenant-Id: efae74f239e14c29b3af28c7fceee94d Apr 14 18:50:37 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-TaggedAttachmentsTest-2056271432 Apr 14 18:50:37 user devstack@n-api.service[61675]: X-User: tempest-TaggedAttachmentsTest-2056271432-project-member Apr 14 18:50:37 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 18:50:37 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 18:50:37 user devstack@n-api.service[61675]: X-User-Id: b083d961ab7546a7bb743d034c5e0815 Apr 14 18:50:37 user devstack@n-api.service[61675]: X-User-Name: tempest-TaggedAttachmentsTest-2056271432-project-member Apr 14 18:50:37 user devstack@n-api.service[61675]: method: > Apr 14 18:50:37 user devstack@n-api.service[61675]: exception: Instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 could not be found. Apr 14 18:50:37 user devstack@n-api.service[61675]: action_args: {'id': 'e3e82a4d-89b7-4bd5-8b22-f17a019e6b99'} Apr 14 18:50:37 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 could not be found. Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 could not be found. Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 could not be found. Apr 14 18:50:37 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:50:37 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-738ca09a-08a8-4c91-bf64-586171e74ae7 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Returning 404 to user: Instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:50:37 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-738ca09a-08a8-4c91-bf64-586171e74ae7 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" status: 404 len: 111 microversion: 2.49 time: 0.061577 Apr 14 18:50:37 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 104/313] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 18:50:37 2023] DELETE /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 18:50:37 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-ae0a13da-bd15-4fd7-b497-af65938e387d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:50:37 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-ae0a13da-bd15-4fd7-b497-af65938e387d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:50:37 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=31 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:50:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ae0a13da-bd15-4fd7-b497-af65938e387d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ae0a13da-bd15-4fd7-b497-af65938e387d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ae0a13da-bd15-4fd7-b497-af65938e387d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ae0a13da-bd15-4fd7-b497-af65938e387d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ae0a13da-bd15-4fd7-b497-af65938e387d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ae0a13da-bd15-4fd7-b497-af65938e387d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:37 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=35 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:50:37 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-ae0a13da-bd15-4fd7-b497-af65938e387d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] HTTP exception thrown: Instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 could not be found. Apr 14 18:50:37 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-ae0a13da-bd15-4fd7-b497-af65938e387d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Request method failure captured: Apr 14 18:50:37 user devstack@n-api.service[61673]: request: GET /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 HTTP/1.1 Apr 14 18:50:37 user devstack@n-api.service[61673]: Accept: application/json Apr 14 18:50:37 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 18:50:37 user devstack@n-api.service[61673]: Connection: close Apr 14 18:50:37 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 18:50:37 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 18:50:37 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 18:50:37 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 18:50:37 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 18:50:37 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOZ9v7WRk1IO6hE58DhwzZXUJPD9CerPThxcj9Wap5ytfpqNsYx6d0x9Ksedq-bx4VJa6Lz4zCvfIoqQCjnJhbCzfiZ3QuC5K4EfBi4Pw1Re0RX3b5gAbXik06uZLVk7EmlK3VxAV-JFPuSOu8NHIPU3EOhC94WRDUQ1pWO3I2Q-qHus Apr 14 18:50:37 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 18:50:37 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 18:50:37 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 18:50:37 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 18:50:37 user devstack@n-api.service[61673]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 18:50:37 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 18:50:37 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 18:50:37 user devstack@n-api.service[61673]: X-Project-Id: efae74f239e14c29b3af28c7fceee94d Apr 14 18:50:37 user devstack@n-api.service[61673]: X-Project-Name: tempest-TaggedAttachmentsTest-2056271432 Apr 14 18:50:37 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 18:50:37 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 18:50:37 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/efae74f239e14c29b3af28c7fceee94d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/efae74f239e14c29b3af28c7fceee94d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/efae74f239e14c29b3af28c7fceee94d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:50:37 user devstack@n-api.service[61673]: X-Tenant: tempest-TaggedAttachmentsTest-2056271432 Apr 14 18:50:37 user devstack@n-api.service[61673]: X-Tenant-Id: efae74f239e14c29b3af28c7fceee94d Apr 14 18:50:37 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-TaggedAttachmentsTest-2056271432 Apr 14 18:50:37 user devstack@n-api.service[61673]: X-User: tempest-TaggedAttachmentsTest-2056271432-project-member Apr 14 18:50:37 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 18:50:37 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 18:50:37 user devstack@n-api.service[61673]: X-User-Id: b083d961ab7546a7bb743d034c5e0815 Apr 14 18:50:37 user devstack@n-api.service[61673]: X-User-Name: tempest-TaggedAttachmentsTest-2056271432-project-member Apr 14 18:50:37 user devstack@n-api.service[61673]: method: > Apr 14 18:50:37 user devstack@n-api.service[61673]: exception: Instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 could not be found. Apr 14 18:50:37 user devstack@n-api.service[61673]: action_args: {'id': 'e3e82a4d-89b7-4bd5-8b22-f17a019e6b99'} Apr 14 18:50:37 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 could not be found. Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 could not be found. Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 could not be found. Apr 14 18:50:37 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:50:37 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-ae0a13da-bd15-4fd7-b497-af65938e387d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Returning 404 to user: Instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:50:37 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-ae0a13da-bd15-4fd7-b497-af65938e387d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" status: 404 len: 111 microversion: 2.49 time: 0.051930 Apr 14 18:50:37 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 103/314] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:50:37 2023] GET /compute/v2.1/servers/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 18:50:43 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-907b298f-d656-46ac-8faa-64b9b8449bd3 req-df5fe897-3c9a-4777-aee4-124ce0f5803f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "tag": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-907b298f-d656-46ac-8faa-64b9b8449bd3 req-df5fe897-3c9a-4777-aee4-124ce0f5803f service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-907b298f-d656-46ac-8faa-64b9b8449bd3 req-df5fe897-3c9a-4777-aee4-124ce0f5803f service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-907b298f-d656-46ac-8faa-64b9b8449bd3 req-df5fe897-3c9a-4777-aee4-124ce0f5803f service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:43 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-907b298f-d656-46ac-8faa-64b9b8449bd3 req-df5fe897-3c9a-4777-aee4-124ce0f5803f service nova] Creating event network-changed:7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8 for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:50:43 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-907b298f-d656-46ac-8faa-64b9b8449bd3 req-df5fe897-3c9a-4777-aee4-124ce0f5803f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043921 Apr 14 18:50:43 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 108/315] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:50:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:50:45 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-a42be3fb-e419-41c2-8c6e-a3f1d9953b2c req-2568c153-626d-4332-8365-f83d6415c150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "tag": "2af029d9-055b-406b-a82d-a88d8b51c4fa"}, {"name": "network-changed", "server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "tag": "f4fbff28-9aec-444f-aef4-a67e882a9255"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:45 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:50:45 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=16 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:50:45 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-a42be3fb-e419-41c2-8c6e-a3f1d9953b2c req-2568c153-626d-4332-8365-f83d6415c150 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:45 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-a42be3fb-e419-41c2-8c6e-a3f1d9953b2c req-2568c153-626d-4332-8365-f83d6415c150 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:45 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-a42be3fb-e419-41c2-8c6e-a3f1d9953b2c req-2568c153-626d-4332-8365-f83d6415c150 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:45 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-a42be3fb-e419-41c2-8c6e-a3f1d9953b2c req-2568c153-626d-4332-8365-f83d6415c150 service nova] Creating event network-changed:2af029d9-055b-406b-a82d-a88d8b51c4fa for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:50:45 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-a42be3fb-e419-41c2-8c6e-a3f1d9953b2c req-2568c153-626d-4332-8365-f83d6415c150 service nova] Creating event network-changed:f4fbff28-9aec-444f-aef4-a67e882a9255 for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:50:45 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-a42be3fb-e419-41c2-8c6e-a3f1d9953b2c req-2568c153-626d-4332-8365-f83d6415c150 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.062373 Apr 14 18:50:45 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 105/316] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:50:45 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:50:47 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-42aaa425-0f5e-4186-93fb-f8a6a33f5880 req-09b63ad1-a107-4bbc-a21c-483f6e7d478a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "tag": "6dc22897-5349-4914-8ab8-eafee74a17dc"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:47 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:50:47 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:50:47 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:50:47 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-42aaa425-0f5e-4186-93fb-f8a6a33f5880 req-09b63ad1-a107-4bbc-a21c-483f6e7d478a service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:47 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-42aaa425-0f5e-4186-93fb-f8a6a33f5880 req-09b63ad1-a107-4bbc-a21c-483f6e7d478a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:47 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-42aaa425-0f5e-4186-93fb-f8a6a33f5880 req-09b63ad1-a107-4bbc-a21c-483f6e7d478a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:47 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-42aaa425-0f5e-4186-93fb-f8a6a33f5880 req-09b63ad1-a107-4bbc-a21c-483f6e7d478a service nova] Creating event network-changed:6dc22897-5349-4914-8ab8-eafee74a17dc for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:50:47 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-42aaa425-0f5e-4186-93fb-f8a6a33f5880 req-09b63ad1-a107-4bbc-a21c-483f6e7d478a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066778 Apr 14 18:50:47 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 104/317] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:50:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:50:49 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-58b2138c-c001-4965-8d17-e31d1c00089e req-db8e3566-1af3-4826-b134-f4ed4f27cca6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "tag": "6b1efba7-12bf-4333-a320-c76218ba1b09"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-58b2138c-c001-4965-8d17-e31d1c00089e req-db8e3566-1af3-4826-b134-f4ed4f27cca6 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-58b2138c-c001-4965-8d17-e31d1c00089e req-db8e3566-1af3-4826-b134-f4ed4f27cca6 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-58b2138c-c001-4965-8d17-e31d1c00089e req-db8e3566-1af3-4826-b134-f4ed4f27cca6 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:49 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-58b2138c-c001-4965-8d17-e31d1c00089e req-db8e3566-1af3-4826-b134-f4ed4f27cca6 service nova] Creating event network-changed:6b1efba7-12bf-4333-a320-c76218ba1b09 for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:50:49 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-58b2138c-c001-4965-8d17-e31d1c00089e req-db8e3566-1af3-4826-b134-f4ed4f27cca6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032750 Apr 14 18:50:49 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 109/318] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:50:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:50:51 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "56a2ce04-e0cd-4616-b0e4-c76c59fd278e"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:51 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:50:51 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:51 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:51 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:51 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:51 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:51 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:51 user devstack@n-api.service[61675]: DEBUG nova.objects.instance [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lazy-loading 'flavor' on Instance uuid 23d14a51-41aa-4827-bd60-c605d9689bc8 {{(pid=61675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 18:50:51 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-07465a4f-2951-4342-9897-f85db6c4da7b req-273c6676-cc02-46d7-8c48-39fdc38d0942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "tag": "3ad5bb9e-1641-4726-887d-031aeadf4c60"}, {"name": "network-changed", "server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "tag": "bb067fd8-e349-48fe-8450-b2308b4ccdab"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:51 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-07465a4f-2951-4342-9897-f85db6c4da7b req-273c6676-cc02-46d7-8c48-39fdc38d0942 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:51 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-07465a4f-2951-4342-9897-f85db6c4da7b req-273c6676-cc02-46d7-8c48-39fdc38d0942 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:51 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-07465a4f-2951-4342-9897-f85db6c4da7b req-273c6676-cc02-46d7-8c48-39fdc38d0942 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:51 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-07465a4f-2951-4342-9897-f85db6c4da7b req-273c6676-cc02-46d7-8c48-39fdc38d0942 service nova] Creating event network-changed:3ad5bb9e-1641-4726-887d-031aeadf4c60 for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:50:51 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-07465a4f-2951-4342-9897-f85db6c4da7b req-273c6676-cc02-46d7-8c48-39fdc38d0942 service nova] Creating event network-changed:bb067fd8-e349-48fe-8450-b2308b4ccdab for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:50:51 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-07465a4f-2951-4342-9897-f85db6c4da7b req-273c6676-cc02-46d7-8c48-39fdc38d0942 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.032219 Apr 14 18:50:51 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 105/319] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:50:51 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:50:52 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "POST /compute/v2.1/servers/23d14a51-41aa-4827-bd60-c605d9689bc8/action" status: 200 len: 29 microversion: 2.87 time: 0.726358 Apr 14 18:50:52 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 106/320] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 18:50:51 2023] POST /compute/v2.1/servers/23d14a51-41aa-4827-bd60-c605d9689bc8/action => generated 29 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:50:52 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-142e9dac-10a0-44ad-82a4-706d8d5f9740 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:50:52 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-142e9dac-10a0-44ad-82a4-706d8d5f9740 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:50:52 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-142e9dac-10a0-44ad-82a4-706d8d5f9740 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:52 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-142e9dac-10a0-44ad-82a4-706d8d5f9740 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:52 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-142e9dac-10a0-44ad-82a4-706d8d5f9740 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:52 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-142e9dac-10a0-44ad-82a4-706d8d5f9740 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:52 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-142e9dac-10a0-44ad-82a4-706d8d5f9740 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:52 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-142e9dac-10a0-44ad-82a4-706d8d5f9740 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:52 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-142e9dac-10a0-44ad-82a4-706d8d5f9740 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:50:52 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-142e9dac-10a0-44ad-82a4-706d8d5f9740 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:50:52 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-142e9dac-10a0-44ad-82a4-706d8d5f9740 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:50:52 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-142e9dac-10a0-44ad-82a4-706d8d5f9740 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23d14a51-41aa-4827-bd60-c605d9689bc8" status: 200 len: 1774 microversion: 2.87 time: 0.432873 Apr 14 18:50:52 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 110/321] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:50:52 2023] GET /compute/v2.1/servers/23d14a51-41aa-4827-bd60-c605d9689bc8 => generated 1774 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:50:52 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1940672222", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "networks": [{"uuid": "6b3ed1e9-fed5-460b-be16-649f80f8992d"}]}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:52 user devstack@n-api.service[61673]: DEBUG nova.network.neutron [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] validate_networks() for [('6b3ed1e9-fed5-460b-be16-649f80f8992d', None, None, None, None, None)] {{(pid=61673) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:50:53 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Flavor limits 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:50:53 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Image limits 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:50:53 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Flavor pref 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:50:53 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Image pref 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:50:53 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:50:53 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:53 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:53 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:53 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:53 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:53 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:53 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Getting quotas for project 95319509fb6a4e58998703975370877a. Resources: {'ram', 'instances', 'cores'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:50:53 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Getting quotas for user 1f3f788e144c46e7bdf6f4fe3a5aeb79 and project 95319509fb6a4e58998703975370877a. Resources: {'ram', 'instances', 'cores'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:50:53 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Going to run 1 instances... {{(pid=61673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:50:53 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:50:53 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.812102 Apr 14 18:50:53 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 106/322] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:50:52 2023] POST /compute/v2.1/servers => generated 378 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:50:53 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-1dc583ba-3197-45a5-81ff-d4dba485428c tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:50:53 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-1dc583ba-3197-45a5-81ff-d4dba485428c tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:50:53 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-1dc583ba-3197-45a5-81ff-d4dba485428c tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3f788e144c46e7bdf6f4fe3a5aeb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95319509fb6a4e58998703975370877a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:50:53 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-1dc583ba-3197-45a5-81ff-d4dba485428c tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1285eca2-575b-4550-a424-605fb186b510" status: 200 len: 1213 microversion: 2.1 time: 0.078987 Apr 14 18:50:53 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 107/323] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:50:53 2023] GET /compute/v2.1/servers/1285eca2-575b-4550-a424-605fb186b510 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:50:54 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-d4a72d7e-6271-4e3c-bc64-b6dcf1fdc5e7 req-345f456c-7956-4511-9cdb-21212990171a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d14a51-41aa-4827-bd60-c605d9689bc8", "name": "network-vif-unplugged", "status": "completed", "tag": "b8044678-899b-4461-bbf0-cf9fd662e71e"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:54 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-d4a72d7e-6271-4e3c-bc64-b6dcf1fdc5e7 req-345f456c-7956-4511-9cdb-21212990171a service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:54 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-d4a72d7e-6271-4e3c-bc64-b6dcf1fdc5e7 req-345f456c-7956-4511-9cdb-21212990171a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:54 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-d4a72d7e-6271-4e3c-bc64-b6dcf1fdc5e7 req-345f456c-7956-4511-9cdb-21212990171a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:54 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-d4a72d7e-6271-4e3c-bc64-b6dcf1fdc5e7 req-345f456c-7956-4511-9cdb-21212990171a service nova] Creating event network-vif-unplugged:b8044678-899b-4461-bbf0-cf9fd662e71e for instance 23d14a51-41aa-4827-bd60-c605d9689bc8 on user Apr 14 18:50:54 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-d4a72d7e-6271-4e3c-bc64-b6dcf1fdc5e7 req-345f456c-7956-4511-9cdb-21212990171a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060857 Apr 14 18:50:54 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 111/324] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:50:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:50:56 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-d92759e6-44e9-474b-851a-877c9d627d4e req-5ff1d49e-8774-4b47-93d1-cf495ee053b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d14a51-41aa-4827-bd60-c605d9689bc8", "name": "network-vif-plugged", "status": "completed", "tag": "b8044678-899b-4461-bbf0-cf9fd662e71e"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:56 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-d92759e6-44e9-474b-851a-877c9d627d4e req-5ff1d49e-8774-4b47-93d1-cf495ee053b4 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:56 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-d92759e6-44e9-474b-851a-877c9d627d4e req-5ff1d49e-8774-4b47-93d1-cf495ee053b4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:56 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-d92759e6-44e9-474b-851a-877c9d627d4e req-5ff1d49e-8774-4b47-93d1-cf495ee053b4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:56 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-d92759e6-44e9-474b-851a-877c9d627d4e req-5ff1d49e-8774-4b47-93d1-cf495ee053b4 service nova] Creating event network-vif-plugged:b8044678-899b-4461-bbf0-cf9fd662e71e for instance 23d14a51-41aa-4827-bd60-c605d9689bc8 on user Apr 14 18:50:56 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-d92759e6-44e9-474b-851a-877c9d627d4e req-5ff1d49e-8774-4b47-93d1-cf495ee053b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083894 Apr 14 18:50:56 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 107/325] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:50:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:50:57 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-ad94ba53-0c9c-4525-b004-ea65a5bd977c tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:50:57 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-ad94ba53-0c9c-4525-b004-ea65a5bd977c tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:50:57 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ad94ba53-0c9c-4525-b004-ea65a5bd977c tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:57 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ad94ba53-0c9c-4525-b004-ea65a5bd977c tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:57 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ad94ba53-0c9c-4525-b004-ea65a5bd977c tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:57 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ad94ba53-0c9c-4525-b004-ea65a5bd977c tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:57 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ad94ba53-0c9c-4525-b004-ea65a5bd977c tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:57 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ad94ba53-0c9c-4525-b004-ea65a5bd977c tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:57 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-ad94ba53-0c9c-4525-b004-ea65a5bd977c tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] HTTP exception thrown: Instance e03adca9-8b0c-416c-943e-7dce251547c6 could not be found. Apr 14 18:50:57 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-ad94ba53-0c9c-4525-b004-ea65a5bd977c tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Request method failure captured: Apr 14 18:50:57 user devstack@n-api.service[61675]: request: GET /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6 HTTP/1.1 Apr 14 18:50:57 user devstack@n-api.service[61675]: Accept: application/json Apr 14 18:50:57 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 18:50:57 user devstack@n-api.service[61675]: Connection: close Apr 14 18:50:57 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 18:50:57 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 18:50:57 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 18:50:57 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 18:50:57 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 18:50:57 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOZ9xXLxpdoYlQdAz0JDCXeCpiqFinBPPf8MZvy7NOBbsuK0E5vitnatm8RtKGoIT7cpxJKJE5IlFC6oT5-ClecxPgZyOWhC7B5uymmrXQ209LtfYdJzGPuQR03BOveC0FOg4Yy6IyqjTx5aCOjpMd4S9wm2BUw6zo39G4yDg0vq9ZR4 Apr 14 18:50:57 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 18:50:57 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 18:50:57 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 18:50:57 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 18:50:57 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 18:50:57 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 18:50:57 user devstack@n-api.service[61675]: X-Project-Id: 418926b6689d48e3b7288ce32834dc93 Apr 14 18:50:57 user devstack@n-api.service[61675]: X-Project-Name: tempest-TestVolumeSwap-1301939484 Apr 14 18:50:57 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 18:50:57 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 18:50:57 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/418926b6689d48e3b7288ce32834dc93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/418926b6689d48e3b7288ce32834dc93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/418926b6689d48e3b7288ce32834dc93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:50:57 user devstack@n-api.service[61675]: X-Tenant: tempest-TestVolumeSwap-1301939484 Apr 14 18:50:57 user devstack@n-api.service[61675]: X-Tenant-Id: 418926b6689d48e3b7288ce32834dc93 Apr 14 18:50:57 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-TestVolumeSwap-1301939484 Apr 14 18:50:57 user devstack@n-api.service[61675]: X-User: tempest-TestVolumeSwap-1301939484-project-member Apr 14 18:50:57 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 18:50:57 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 18:50:57 user devstack@n-api.service[61675]: X-User-Id: 3acb40ab30d44d5ebd26c3956b6d7e54 Apr 14 18:50:57 user devstack@n-api.service[61675]: X-User-Name: tempest-TestVolumeSwap-1301939484-project-member Apr 14 18:50:57 user devstack@n-api.service[61675]: method: > Apr 14 18:50:57 user devstack@n-api.service[61675]: exception: Instance e03adca9-8b0c-416c-943e-7dce251547c6 could not be found. Apr 14 18:50:57 user devstack@n-api.service[61675]: action_args: {'id': 'e03adca9-8b0c-416c-943e-7dce251547c6'} Apr 14 18:50:57 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e03adca9-8b0c-416c-943e-7dce251547c6 could not be found. Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e03adca9-8b0c-416c-943e-7dce251547c6 could not be found. Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e03adca9-8b0c-416c-943e-7dce251547c6 could not be found. Apr 14 18:50:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:50:57 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-ad94ba53-0c9c-4525-b004-ea65a5bd977c tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Returning 404 to user: Instance e03adca9-8b0c-416c-943e-7dce251547c6 could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:50:57 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-ad94ba53-0c9c-4525-b004-ea65a5bd977c tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6" status: 404 len: 111 microversion: 2.1 time: 0.028660 Apr 14 18:50:57 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 108/326] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:50:57 2023] GET /compute/v2.1/servers/e03adca9-8b0c-416c-943e-7dce251547c6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:50:57 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-b93312b4-1f36-4e07-a714-e7785e7b0cf2 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Calling method '.version_select at 0x7fdae1021120>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:50:57 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-b93312b4-1f36-4e07-a714-e7785e7b0cf2 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-722895534" status: 202 len: 0 microversion: 2.1 time: 0.031284 Apr 14 18:50:57 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 112/327] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 18:50:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-722895534 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:50:58 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-f34b6c65-985a-496d-8c20-c4a8cb712734 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:50:58 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-f34b6c65-985a-496d-8c20-c4a8cb712734 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:50:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f34b6c65-985a-496d-8c20-c4a8cb712734 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f34b6c65-985a-496d-8c20-c4a8cb712734 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f34b6c65-985a-496d-8c20-c4a8cb712734 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f34b6c65-985a-496d-8c20-c4a8cb712734 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f34b6c65-985a-496d-8c20-c4a8cb712734 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f34b6c65-985a-496d-8c20-c4a8cb712734 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:58 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-f34b6c65-985a-496d-8c20-c4a8cb712734 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] HTTP exception thrown: Instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 could not be found. Apr 14 18:50:58 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-f34b6c65-985a-496d-8c20-c4a8cb712734 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Request method failure captured: Apr 14 18:50:58 user devstack@n-api.service[61673]: request: GET /compute/v2.1/servers/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 HTTP/1.1 Apr 14 18:50:58 user devstack@n-api.service[61673]: Accept: application/json Apr 14 18:50:58 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 18:50:58 user devstack@n-api.service[61673]: Connection: close Apr 14 18:50:58 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 18:50:58 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 18:50:58 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 18:50:58 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 18:50:58 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 18:50:58 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOZ9mXKmSeVaIS46ajndcD0QEVOAAeNy4LVRU6htix22YmE3w_WsO57Wi55e6NRGyVz084DhOrXI8Tp0cfqtkOuptABoiofobC3zYryQ5y6CuXjmj_BNK8q3Ywj-icF3eYh62IR4e0eJMk7NufTqqWbSFQxNccWUoyS1F1P0cbefqlTY Apr 14 18:50:58 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 18:50:58 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 18:50:58 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 18:50:58 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 18:50:58 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 18:50:58 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 18:50:58 user devstack@n-api.service[61673]: X-Project-Id: e34cdebcd7154988a957deae140e8eab Apr 14 18:50:58 user devstack@n-api.service[61673]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 18:50:58 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 18:50:58 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 18:50:58 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:50:58 user devstack@n-api.service[61673]: X-Tenant: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 18:50:58 user devstack@n-api.service[61673]: X-Tenant-Id: e34cdebcd7154988a957deae140e8eab Apr 14 18:50:58 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 18:50:58 user devstack@n-api.service[61673]: X-User: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 18:50:58 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 18:50:58 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 18:50:58 user devstack@n-api.service[61673]: X-User-Id: 8d53edaffb8f4038abd366d7942c6bc7 Apr 14 18:50:58 user devstack@n-api.service[61673]: X-User-Name: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 18:50:58 user devstack@n-api.service[61673]: method: > Apr 14 18:50:58 user devstack@n-api.service[61673]: exception: Instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 could not be found. Apr 14 18:50:58 user devstack@n-api.service[61673]: action_args: {'id': 'a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9'} Apr 14 18:50:58 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 could not be found. Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 could not be found. Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 could not be found. Apr 14 18:50:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:50:58 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-f34b6c65-985a-496d-8c20-c4a8cb712734 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Returning 404 to user: Instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:50:58 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-f34b6c65-985a-496d-8c20-c4a8cb712734 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9" status: 404 len: 111 microversion: 2.1 time: 0.051689 Apr 14 18:50:58 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 108/328] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:50:58 2023] GET /compute/v2.1/servers/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:50:58 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-0c42e4a6-82e4-4c73-8abb-daa960c8e0f2 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '.version_select at 0x7fdae11eecb0>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:50:58 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-0c42e4a6-82e4-4c73-8abb-daa960c8e0f2 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1533000139" status: 202 len: 0 microversion: 2.1 time: 0.023145 Apr 14 18:50:58 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 109/329] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 18:50:58 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1533000139 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:50:59 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-ce8c4c97-c665-49cc-b3da-fb3ae45095af req-8416f0b9-1765-4013-b1b7-d7221b6684dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d14a51-41aa-4827-bd60-c605d9689bc8", "name": "network-vif-plugged", "status": "completed", "tag": "b8044678-899b-4461-bbf0-cf9fd662e71e"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-ce8c4c97-c665-49cc-b3da-fb3ae45095af req-8416f0b9-1765-4013-b1b7-d7221b6684dc service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-ce8c4c97-c665-49cc-b3da-fb3ae45095af req-8416f0b9-1765-4013-b1b7-d7221b6684dc service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-ce8c4c97-c665-49cc-b3da-fb3ae45095af req-8416f0b9-1765-4013-b1b7-d7221b6684dc service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:59 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-ce8c4c97-c665-49cc-b3da-fb3ae45095af req-8416f0b9-1765-4013-b1b7-d7221b6684dc service nova] Creating event network-vif-plugged:b8044678-899b-4461-bbf0-cf9fd662e71e for instance 23d14a51-41aa-4827-bd60-c605d9689bc8 on user Apr 14 18:50:59 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-ce8c4c97-c665-49cc-b3da-fb3ae45095af req-8416f0b9-1765-4013-b1b7-d7221b6684dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048911 Apr 14 18:50:59 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 113/330] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:50:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:50:59 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-64304156-c69c-49d4-82c1-477c7a1970fa req-ede45723-3f57-4516-8ca9-48a55b1e7db4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1285eca2-575b-4550-a424-605fb186b510", "tag": "0ccfdc96-01f1-414d-8693-963f116cfd62"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:50:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-64304156-c69c-49d4-82c1-477c7a1970fa req-ede45723-3f57-4516-8ca9-48a55b1e7db4 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:50:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-64304156-c69c-49d4-82c1-477c7a1970fa req-ede45723-3f57-4516-8ca9-48a55b1e7db4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:50:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-64304156-c69c-49d4-82c1-477c7a1970fa req-ede45723-3f57-4516-8ca9-48a55b1e7db4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:50:59 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-64304156-c69c-49d4-82c1-477c7a1970fa req-ede45723-3f57-4516-8ca9-48a55b1e7db4 service nova] Creating event network-changed:0ccfdc96-01f1-414d-8693-963f116cfd62 for instance 1285eca2-575b-4550-a424-605fb186b510 on user Apr 14 18:50:59 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-64304156-c69c-49d4-82c1-477c7a1970fa req-ede45723-3f57-4516-8ca9-48a55b1e7db4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036156 Apr 14 18:50:59 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 109/331] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:50:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:00 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:51:00 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:51:00 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:00 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:00 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:00 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:00 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:00 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:00 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-8c5f39c2-84f1-4d06-806a-30bd48a730ad tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:51:00 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-8c5f39c2-84f1-4d06-806a-30bd48a730ad tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:51:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8c5f39c2-84f1-4d06-806a-30bd48a730ad tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8c5f39c2-84f1-4d06-806a-30bd48a730ad tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8c5f39c2-84f1-4d06-806a-30bd48a730ad tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8c5f39c2-84f1-4d06-806a-30bd48a730ad tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8c5f39c2-84f1-4d06-806a-30bd48a730ad tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8c5f39c2-84f1-4d06-806a-30bd48a730ad tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:00 user devstack@n-api.service[61675]: DEBUG nova.objects.instance [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lazy-loading 'services' on Instance uuid 094a4a33-569e-4137-8798-743499f1046c {{(pid=61675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 18:51:00 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c/os-volume_attachments/8000d5a4-c39b-41b5-a47c-0f83b55fa0ab" status: 202 len: 0 microversion: 2.1 time: 0.352908 Apr 14 18:51:00 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 110/332] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 18:51:00 2023] DELETE /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c/os-volume_attachments/8000d5a4-c39b-41b5-a47c-0f83b55fa0ab => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:51:00 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-9352a4f6-7594-4e1d-96f3-8f408ed3d88c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:51:00 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-9352a4f6-7594-4e1d-96f3-8f408ed3d88c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:51:00 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9352a4f6-7594-4e1d-96f3-8f408ed3d88c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:00 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9352a4f6-7594-4e1d-96f3-8f408ed3d88c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:00 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9352a4f6-7594-4e1d-96f3-8f408ed3d88c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:00 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9352a4f6-7594-4e1d-96f3-8f408ed3d88c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:00 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9352a4f6-7594-4e1d-96f3-8f408ed3d88c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:00 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9352a4f6-7594-4e1d-96f3-8f408ed3d88c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:00 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-9352a4f6-7594-4e1d-96f3-8f408ed3d88c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052847 Apr 14 18:51:00 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 110/333] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:51:00 2023] GET /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:00 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-8c5f39c2-84f1-4d06-806a-30bd48a730ad tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ed7885e7774691b02c19cf08c2177f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d84c59848f445a90eb7eab6be04253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:51:00 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-8c5f39c2-84f1-4d06-806a-30bd48a730ad tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c" status: 200 len: 1705 microversion: 2.1 time: 0.299431 Apr 14 18:51:00 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 114/334] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:51:00 2023] GET /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c => generated 1705 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:51:01 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-829091f3-2aa2-4c73-a14b-a64bf669cb2f req-cd187d72-74e7-449a-bc1f-19f761dc7336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d14a51-41aa-4827-bd60-c605d9689bc8", "name": "network-vif-plugged", "status": "completed", "tag": "b8044678-899b-4461-bbf0-cf9fd662e71e"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-829091f3-2aa2-4c73-a14b-a64bf669cb2f req-cd187d72-74e7-449a-bc1f-19f761dc7336 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-829091f3-2aa2-4c73-a14b-a64bf669cb2f req-cd187d72-74e7-449a-bc1f-19f761dc7336 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-829091f3-2aa2-4c73-a14b-a64bf669cb2f req-cd187d72-74e7-449a-bc1f-19f761dc7336 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:01 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-829091f3-2aa2-4c73-a14b-a64bf669cb2f req-cd187d72-74e7-449a-bc1f-19f761dc7336 service nova] Creating event network-vif-plugged:b8044678-899b-4461-bbf0-cf9fd662e71e for instance 23d14a51-41aa-4827-bd60-c605d9689bc8 on user Apr 14 18:51:01 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-829091f3-2aa2-4c73-a14b-a64bf669cb2f req-cd187d72-74e7-449a-bc1f-19f761dc7336 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038941 Apr 14 18:51:01 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 111/335] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:51:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:02 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-e787eef1-97c6-47c0-a5ac-27afc2b9fa1a req-0914a46c-c8da-4790-a437-85bda8ab1c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1285eca2-575b-4550-a424-605fb186b510", "name": "network-vif-plugged", "status": "completed", "tag": "0ccfdc96-01f1-414d-8693-963f116cfd62"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-e787eef1-97c6-47c0-a5ac-27afc2b9fa1a req-0914a46c-c8da-4790-a437-85bda8ab1c30 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-e787eef1-97c6-47c0-a5ac-27afc2b9fa1a req-0914a46c-c8da-4790-a437-85bda8ab1c30 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-e787eef1-97c6-47c0-a5ac-27afc2b9fa1a req-0914a46c-c8da-4790-a437-85bda8ab1c30 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:02 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-e787eef1-97c6-47c0-a5ac-27afc2b9fa1a req-0914a46c-c8da-4790-a437-85bda8ab1c30 service nova] Creating event network-vif-plugged:0ccfdc96-01f1-414d-8693-963f116cfd62 for instance 1285eca2-575b-4550-a424-605fb186b510 on user Apr 14 18:51:02 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-e787eef1-97c6-47c0-a5ac-27afc2b9fa1a req-0914a46c-c8da-4790-a437-85bda8ab1c30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032811 Apr 14 18:51:02 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 111/336] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:51:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:04 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-7d54bb17-19bc-4993-ba84-4b447098a507 req-a3eb5fd4-55dd-423d-ad0b-249d8eb76e36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1285eca2-575b-4550-a424-605fb186b510", "name": "network-vif-plugged", "status": "completed", "tag": "0ccfdc96-01f1-414d-8693-963f116cfd62"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:04 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:51:04 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-7d54bb17-19bc-4993-ba84-4b447098a507 req-a3eb5fd4-55dd-423d-ad0b-249d8eb76e36 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:04 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-7d54bb17-19bc-4993-ba84-4b447098a507 req-a3eb5fd4-55dd-423d-ad0b-249d8eb76e36 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:04 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-7d54bb17-19bc-4993-ba84-4b447098a507 req-a3eb5fd4-55dd-423d-ad0b-249d8eb76e36 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:04 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=24 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:51:04 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-7d54bb17-19bc-4993-ba84-4b447098a507 req-a3eb5fd4-55dd-423d-ad0b-249d8eb76e36 service nova] Creating event network-vif-plugged:0ccfdc96-01f1-414d-8693-963f116cfd62 for instance 1285eca2-575b-4550-a424-605fb186b510 on user Apr 14 18:51:04 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-7d54bb17-19bc-4993-ba84-4b447098a507 req-a3eb5fd4-55dd-423d-ad0b-249d8eb76e36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044225 Apr 14 18:51:04 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 115/337] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:51:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:07 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:51:07 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-ebad2ff5-e8a1-4705-bac4-fd7897d2a334 req-0b47e28d-db8d-490d-8c37-6e8af2044799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-plugged", "status": "completed", "tag": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:07 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:51:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-ebad2ff5-e8a1-4705-bac4-fd7897d2a334 req-0b47e28d-db8d-490d-8c37-6e8af2044799 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-ebad2ff5-e8a1-4705-bac4-fd7897d2a334 req-0b47e28d-db8d-490d-8c37-6e8af2044799 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-ebad2ff5-e8a1-4705-bac4-fd7897d2a334 req-0b47e28d-db8d-490d-8c37-6e8af2044799 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:07 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:51:07 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-ebad2ff5-e8a1-4705-bac4-fd7897d2a334 req-0b47e28d-db8d-490d-8c37-6e8af2044799 service nova] Creating event network-vif-plugged:7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8 for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:51:07 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-ebad2ff5-e8a1-4705-bac4-fd7897d2a334 req-0b47e28d-db8d-490d-8c37-6e8af2044799 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071413 Apr 14 18:51:07 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 112/338] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:51:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:08 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:51:08 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=6 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:51:08 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-bfa8a4ec-a6e8-447d-a9a6-9537990730c6 req-7c0d719b-7f02-453a-847e-11b9cd81a4f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-plugged", "status": "completed", "tag": "f4fbff28-9aec-444f-aef4-a67e882a9255"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-bfa8a4ec-a6e8-447d-a9a6-9537990730c6 req-7c0d719b-7f02-453a-847e-11b9cd81a4f2 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-bfa8a4ec-a6e8-447d-a9a6-9537990730c6 req-7c0d719b-7f02-453a-847e-11b9cd81a4f2 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-bfa8a4ec-a6e8-447d-a9a6-9537990730c6 req-7c0d719b-7f02-453a-847e-11b9cd81a4f2 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:08 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-bfa8a4ec-a6e8-447d-a9a6-9537990730c6 req-7c0d719b-7f02-453a-847e-11b9cd81a4f2 service nova] Creating event network-vif-plugged:f4fbff28-9aec-444f-aef4-a67e882a9255 for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:51:08 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-bfa8a4ec-a6e8-447d-a9a6-9537990730c6 req-7c0d719b-7f02-453a-847e-11b9cd81a4f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084922 Apr 14 18:51:08 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 112/339] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:51:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:09 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-53879a59-4a5d-462b-a1e9-4696d5aba5db req-be7465f0-872c-414c-bf77-7e58d75d473e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-plugged", "status": "completed", "tag": "6dc22897-5349-4914-8ab8-eafee74a17dc"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-53879a59-4a5d-462b-a1e9-4696d5aba5db req-be7465f0-872c-414c-bf77-7e58d75d473e service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-53879a59-4a5d-462b-a1e9-4696d5aba5db req-be7465f0-872c-414c-bf77-7e58d75d473e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-53879a59-4a5d-462b-a1e9-4696d5aba5db req-be7465f0-872c-414c-bf77-7e58d75d473e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:09 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-53879a59-4a5d-462b-a1e9-4696d5aba5db req-be7465f0-872c-414c-bf77-7e58d75d473e service nova] Creating event network-vif-plugged:6dc22897-5349-4914-8ab8-eafee74a17dc for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:51:09 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-53879a59-4a5d-462b-a1e9-4696d5aba5db req-be7465f0-872c-414c-bf77-7e58d75d473e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088678 Apr 14 18:51:09 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 116/340] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:51:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:09 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-398bc6da-d6fb-4d1d-9991-ec80c74276ea req-56ec0e6f-df1e-43ad-a1d3-b0bf6a5e575f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-plugged", "status": "completed", "tag": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8"}, {"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-plugged", "status": "completed", "tag": "2af029d9-055b-406b-a82d-a88d8b51c4fa"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-398bc6da-d6fb-4d1d-9991-ec80c74276ea req-56ec0e6f-df1e-43ad-a1d3-b0bf6a5e575f service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-398bc6da-d6fb-4d1d-9991-ec80c74276ea req-56ec0e6f-df1e-43ad-a1d3-b0bf6a5e575f service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-398bc6da-d6fb-4d1d-9991-ec80c74276ea req-56ec0e6f-df1e-43ad-a1d3-b0bf6a5e575f service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:10 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-398bc6da-d6fb-4d1d-9991-ec80c74276ea req-56ec0e6f-df1e-43ad-a1d3-b0bf6a5e575f service nova] Creating event network-vif-plugged:7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8 for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:51:10 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-398bc6da-d6fb-4d1d-9991-ec80c74276ea req-56ec0e6f-df1e-43ad-a1d3-b0bf6a5e575f service nova] Creating event network-vif-plugged:2af029d9-055b-406b-a82d-a88d8b51c4fa for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:51:10 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-398bc6da-d6fb-4d1d-9991-ec80c74276ea req-56ec0e6f-df1e-43ad-a1d3-b0bf6a5e575f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.130644 Apr 14 18:51:10 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 113/341] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:51:09 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:10 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-plugged", "status": "completed", "tag": "f4fbff28-9aec-444f-aef4-a67e882a9255"}, {"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-plugged", "status": "completed", "tag": "6b1efba7-12bf-4333-a320-c76218ba1b09"}, {"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-plugged", "status": "completed", "tag": "6b1efba7-12bf-4333-a320-c76218ba1b09"}, {"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-plugged", "status": "completed", "tag": "3ad5bb9e-1641-4726-887d-031aeadf4c60"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:10 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] Creating event network-vif-plugged:f4fbff28-9aec-444f-aef4-a67e882a9255 for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:51:10 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] Creating event network-vif-plugged:6b1efba7-12bf-4333-a320-c76218ba1b09 for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:51:10 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] Creating event network-vif-plugged:6b1efba7-12bf-4333-a320-c76218ba1b09 for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:51:10 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] Creating event network-vif-plugged:3ad5bb9e-1641-4726-887d-031aeadf4c60 for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:51:10 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.100153 Apr 14 18:51:10 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 113/342] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:51:10 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:11 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-d35a483c-0a72-4567-a4b3-92c6289222f8 req-696444a3-84df-47ec-8e78-d06f8fc199c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-plugged", "status": "completed", "tag": "6dc22897-5349-4914-8ab8-eafee74a17dc"}, {"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-plugged", "status": "completed", "tag": "bb067fd8-e349-48fe-8450-b2308b4ccdab"}, {"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-plugged", "status": "completed", "tag": "bb067fd8-e349-48fe-8450-b2308b4ccdab"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:11 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-d35a483c-0a72-4567-a4b3-92c6289222f8 req-696444a3-84df-47ec-8e78-d06f8fc199c4 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:11 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-d35a483c-0a72-4567-a4b3-92c6289222f8 req-696444a3-84df-47ec-8e78-d06f8fc199c4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:11 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-d35a483c-0a72-4567-a4b3-92c6289222f8 req-696444a3-84df-47ec-8e78-d06f8fc199c4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:11 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-d35a483c-0a72-4567-a4b3-92c6289222f8 req-696444a3-84df-47ec-8e78-d06f8fc199c4 service nova] Creating event network-vif-plugged:6dc22897-5349-4914-8ab8-eafee74a17dc for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:51:11 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-d35a483c-0a72-4567-a4b3-92c6289222f8 req-696444a3-84df-47ec-8e78-d06f8fc199c4 service nova] Creating event network-vif-plugged:bb067fd8-e349-48fe-8450-b2308b4ccdab for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:51:11 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-d35a483c-0a72-4567-a4b3-92c6289222f8 req-696444a3-84df-47ec-8e78-d06f8fc199c4 service nova] Creating event network-vif-plugged:bb067fd8-e349-48fe-8450-b2308b4ccdab for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:51:11 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-d35a483c-0a72-4567-a4b3-92c6289222f8 req-696444a3-84df-47ec-8e78-d06f8fc199c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.060231 Apr 14 18:51:11 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 117/343] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:51:11 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:12 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-ba5eba97-9db7-42f0-b32d-c685094db840 req-e376da8b-3f02-44b4-bb75-66fc8f79e075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-plugged", "status": "completed", "tag": "2af029d9-055b-406b-a82d-a88d8b51c4fa"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-ba5eba97-9db7-42f0-b32d-c685094db840 req-e376da8b-3f02-44b4-bb75-66fc8f79e075 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-ba5eba97-9db7-42f0-b32d-c685094db840 req-e376da8b-3f02-44b4-bb75-66fc8f79e075 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-ba5eba97-9db7-42f0-b32d-c685094db840 req-e376da8b-3f02-44b4-bb75-66fc8f79e075 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:12 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-ba5eba97-9db7-42f0-b32d-c685094db840 req-e376da8b-3f02-44b4-bb75-66fc8f79e075 service nova] Creating event network-vif-plugged:2af029d9-055b-406b-a82d-a88d8b51c4fa for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:51:12 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-ba5eba97-9db7-42f0-b32d-c685094db840 req-e376da8b-3f02-44b4-bb75-66fc8f79e075 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039351 Apr 14 18:51:12 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 114/344] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:51:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:12 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-44a8b9bf-a01b-43e9-902b-d72278bb476a req-b9355a91-6d7a-485b-aff3-e890a955fd35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-plugged", "status": "completed", "tag": "3ad5bb9e-1641-4726-887d-031aeadf4c60"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:12 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-44a8b9bf-a01b-43e9-902b-d72278bb476a req-b9355a91-6d7a-485b-aff3-e890a955fd35 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:12 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-44a8b9bf-a01b-43e9-902b-d72278bb476a req-b9355a91-6d7a-485b-aff3-e890a955fd35 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:12 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-44a8b9bf-a01b-43e9-902b-d72278bb476a req-b9355a91-6d7a-485b-aff3-e890a955fd35 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:12 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-44a8b9bf-a01b-43e9-902b-d72278bb476a req-b9355a91-6d7a-485b-aff3-e890a955fd35 service nova] Creating event network-vif-plugged:3ad5bb9e-1641-4726-887d-031aeadf4c60 for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:51:12 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-4e6509ac-afcb-4653-90b3-e83ca0245160 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:51:12 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-4e6509ac-afcb-4653-90b3-e83ca0245160 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:51:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4e6509ac-afcb-4653-90b3-e83ca0245160 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4e6509ac-afcb-4653-90b3-e83ca0245160 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4e6509ac-afcb-4653-90b3-e83ca0245160 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4e6509ac-afcb-4653-90b3-e83ca0245160 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:12 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-44a8b9bf-a01b-43e9-902b-d72278bb476a req-b9355a91-6d7a-485b-aff3-e890a955fd35 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056194 Apr 14 18:51:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4e6509ac-afcb-4653-90b3-e83ca0245160 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4e6509ac-afcb-4653-90b3-e83ca0245160 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:12 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 114/345] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:51:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:13 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-4e6509ac-afcb-4653-90b3-e83ca0245160 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8713ed85ffb4446847f5ded4bc2e399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60e8abd123e414f847c68ba72894689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:51:13 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-4e6509ac-afcb-4653-90b3-e83ca0245160 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf640f3e-3d77-46ee-8a11-e0bdc870ff97" status: 200 len: 1503 microversion: 2.1 time: 0.363114 Apr 14 18:51:13 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 118/346] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:51:12 2023] GET /compute/v2.1/servers/cf640f3e-3d77-46ee-8a11-e0bdc870ff97 => generated 1503 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:51:14 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-c0684bbe-1571-4179-a5a5-711dca76b20a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:51:14 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-c0684bbe-1571-4179-a5a5-711dca76b20a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:51:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c0684bbe-1571-4179-a5a5-711dca76b20a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c0684bbe-1571-4179-a5a5-711dca76b20a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c0684bbe-1571-4179-a5a5-711dca76b20a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c0684bbe-1571-4179-a5a5-711dca76b20a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c0684bbe-1571-4179-a5a5-711dca76b20a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c0684bbe-1571-4179-a5a5-711dca76b20a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:14 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-c0684bbe-1571-4179-a5a5-711dca76b20a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:51:14 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-c0684bbe-1571-4179-a5a5-711dca76b20a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 200 len: 1721 microversion: 2.1 time: 0.490143 Apr 14 18:51:14 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 115/347] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:51:13 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 1721 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:51:14 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-961524b8-27b1-485d-ac73-e50453af5b18 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:51:14 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-961524b8-27b1-485d-ac73-e50453af5b18 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:51:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-961524b8-27b1-485d-ac73-e50453af5b18 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-961524b8-27b1-485d-ac73-e50453af5b18 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-961524b8-27b1-485d-ac73-e50453af5b18 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-961524b8-27b1-485d-ac73-e50453af5b18 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-961524b8-27b1-485d-ac73-e50453af5b18 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-961524b8-27b1-485d-ac73-e50453af5b18 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:14 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-961524b8-27b1-485d-ac73-e50453af5b18 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:51:14 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-961524b8-27b1-485d-ac73-e50453af5b18 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 200 len: 1721 microversion: 2.1 time: 0.381605 Apr 14 18:51:14 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 115/348] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:51:14 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 1721 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:51:20 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-14579368-a600-4213-8bd4-a6ec66372756 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1539870350"}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:20 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-14579368-a600-4213-8bd4-a6ec66372756 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:51:20 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-14579368-a600-4213-8bd4-a6ec66372756 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:20 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-14579368-a600-4213-8bd4-a6ec66372756 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:20 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-14579368-a600-4213-8bd4-a6ec66372756 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:20 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-14579368-a600-4213-8bd4-a6ec66372756 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:20 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-14579368-a600-4213-8bd4-a6ec66372756 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:20 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-14579368-a600-4213-8bd4-a6ec66372756 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:20 user devstack@n-api.service[61674]: INFO nova.network.security_group_api [None req-14579368-a600-4213-8bd4-a6ec66372756 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Removing security group 6763cae2-7915-4d18-8246-14341af2f11f from port 324b6810-d265-48bc-a2a9-ff7d4759a910 Apr 14 18:51:21 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-14579368-a600-4213-8bd4-a6ec66372756 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "POST /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae/action" status: 202 len: 0 microversion: 2.1 time: 0.780681 Apr 14 18:51:21 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 119/349] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 18:51:20 2023] POST /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae/action => generated 0 bytes in 782 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:51:21 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-7002c653-ca56-4415-9f00-d0af76d09db3 req-64412942-d7fc-4ec5-b06f-dd5ca888ae30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "656b9f90-ce93-42cd-aa1b-3ff868162aae", "tag": "324b6810-d265-48bc-a2a9-ff7d4759a910"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:21 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-7002c653-ca56-4415-9f00-d0af76d09db3 req-64412942-d7fc-4ec5-b06f-dd5ca888ae30 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:21 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-7002c653-ca56-4415-9f00-d0af76d09db3 req-64412942-d7fc-4ec5-b06f-dd5ca888ae30 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:21 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-7002c653-ca56-4415-9f00-d0af76d09db3 req-64412942-d7fc-4ec5-b06f-dd5ca888ae30 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:21 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-7002c653-ca56-4415-9f00-d0af76d09db3 req-64412942-d7fc-4ec5-b06f-dd5ca888ae30 service nova] Creating event network-changed:324b6810-d265-48bc-a2a9-ff7d4759a910 for instance 656b9f90-ce93-42cd-aa1b-3ff868162aae on user Apr 14 18:51:21 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-7002c653-ca56-4415-9f00-d0af76d09db3 req-64412942-d7fc-4ec5-b06f-dd5ca888ae30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039226 Apr 14 18:51:21 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 116/350] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:51:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:22 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:51:22 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:51:22 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:51:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:22 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=33 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:51:22 user devstack@n-api.service[61673]: DEBUG nova.objects.instance [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lazy-loading 'services' on Instance uuid 656b9f90-ce93-42cd-aa1b-3ff868162aae {{(pid=61673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 18:51:22 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae/os-volume_attachments/31ad3520-e4ab-4564-8a4f-b1f9afc6d344" status: 202 len: 0 microversion: 2.1 time: 0.220902 Apr 14 18:51:22 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 116/351] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 18:51:22 2023] DELETE /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae/os-volume_attachments/31ad3520-e4ab-4564-8a4f-b1f9afc6d344 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:51:22 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-e81adfff-5391-42e7-945b-867852e5f814 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:51:22 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-e81adfff-5391-42e7-945b-867852e5f814 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:51:22 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e81adfff-5391-42e7-945b-867852e5f814 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:22 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e81adfff-5391-42e7-945b-867852e5f814 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:22 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e81adfff-5391-42e7-945b-867852e5f814 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:22 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e81adfff-5391-42e7-945b-867852e5f814 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:22 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e81adfff-5391-42e7-945b-867852e5f814 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:22 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e81adfff-5391-42e7-945b-867852e5f814 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:22 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-e81adfff-5391-42e7-945b-867852e5f814 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092319 Apr 14 18:51:22 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 120/352] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:51:22 2023] GET /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 18:51:23 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-28f8d48a-a063-4296-a87f-bb2aec9296d1 req-32a9f6cc-90f1-44c5-b282-01512e735e6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "656b9f90-ce93-42cd-aa1b-3ff868162aae", "tag": "324b6810-d265-48bc-a2a9-ff7d4759a910"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-28f8d48a-a063-4296-a87f-bb2aec9296d1 req-32a9f6cc-90f1-44c5-b282-01512e735e6d service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-28f8d48a-a063-4296-a87f-bb2aec9296d1 req-32a9f6cc-90f1-44c5-b282-01512e735e6d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-28f8d48a-a063-4296-a87f-bb2aec9296d1 req-32a9f6cc-90f1-44c5-b282-01512e735e6d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:23 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-28f8d48a-a063-4296-a87f-bb2aec9296d1 req-32a9f6cc-90f1-44c5-b282-01512e735e6d service nova] Creating event network-changed:324b6810-d265-48bc-a2a9-ff7d4759a910 for instance 656b9f90-ce93-42cd-aa1b-3ff868162aae on user Apr 14 18:51:23 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-28f8d48a-a063-4296-a87f-bb2aec9296d1 req-32a9f6cc-90f1-44c5-b282-01512e735e6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125096 Apr 14 18:51:23 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 117/353] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:51:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:24 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-9e51ffab-aa45-4570-a1ac-ca1d984a458e tempest-VolumesAdminNegativeTest-1430126587 tempest-VolumesAdminNegativeTest-1430126587-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "fcde2e44-66ca-4082-89b0-5ca91fdc35e6"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:24 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-9e51ffab-aa45-4570-a1ac-ca1d984a458e tempest-VolumesAdminNegativeTest-1430126587 tempest-VolumesAdminNegativeTest-1430126587-project-admin] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:51:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9e51ffab-aa45-4570-a1ac-ca1d984a458e tempest-VolumesAdminNegativeTest-1430126587 tempest-VolumesAdminNegativeTest-1430126587-project-admin] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9e51ffab-aa45-4570-a1ac-ca1d984a458e tempest-VolumesAdminNegativeTest-1430126587 tempest-VolumesAdminNegativeTest-1430126587-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9e51ffab-aa45-4570-a1ac-ca1d984a458e tempest-VolumesAdminNegativeTest-1430126587 tempest-VolumesAdminNegativeTest-1430126587-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9e51ffab-aa45-4570-a1ac-ca1d984a458e tempest-VolumesAdminNegativeTest-1430126587 tempest-VolumesAdminNegativeTest-1430126587-project-admin] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9e51ffab-aa45-4570-a1ac-ca1d984a458e tempest-VolumesAdminNegativeTest-1430126587 tempest-VolumesAdminNegativeTest-1430126587-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9e51ffab-aa45-4570-a1ac-ca1d984a458e tempest-VolumesAdminNegativeTest-1430126587 tempest-VolumesAdminNegativeTest-1430126587-project-admin] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:24 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-9e51ffab-aa45-4570-a1ac-ca1d984a458e tempest-VolumesAdminNegativeTest-1430126587 tempest-VolumesAdminNegativeTest-1430126587-project-admin] HTTP exception thrown: Volume 6834a171-76e7-4c89-a5ea-fa288063fc1a could not be found. Apr 14 18:51:24 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-9e51ffab-aa45-4570-a1ac-ca1d984a458e tempest-VolumesAdminNegativeTest-1430126587 tempest-VolumesAdminNegativeTest-1430126587-project-admin] Request method failure captured: Apr 14 18:51:24 user devstack@n-api.service[61673]: request: PUT /compute/v2.1/servers/482b8c77-c963-4bc1-8e3c-847650736767/os-volume_attachments/6834a171-76e7-4c89-a5ea-fa288063fc1a HTTP/1.1 Apr 14 18:51:24 user devstack@n-api.service[61673]: Accept: application/json Apr 14 18:51:24 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 18:51:24 user devstack@n-api.service[61673]: Connection: close Apr 14 18:51:24 user devstack@n-api.service[61673]: Content-Length: 74 Apr 14 18:51:24 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 18:51:24 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 18:51:24 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 18:51:24 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 18:51:24 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOZ-FTpfNnFyxhHYJ_jxQ1hbgrgtd4k8nVsWkL4N4mZPP5e4Mgja9yh244QBt-D9iNmQ3zmggdtxHubF09LrydVv2TlK8Bvl_cjLW7qmqZ9DfkyCuZd1HrAvru36EwmxK3jQRpdCyUb-OGlowBYM2zTru-mdJaMqVHfFWC9-kT6uyB18 Apr 14 18:51:24 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 18:51:24 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 18:51:24 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 18:51:24 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 18:51:24 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 18:51:24 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 18:51:24 user devstack@n-api.service[61673]: X-Project-Id: 5ea32fe1b14144a5889d4f9756ac49df Apr 14 18:51:24 user devstack@n-api.service[61673]: X-Project-Name: tempest-VolumesAdminNegativeTest-1430126587 Apr 14 18:51:24 user devstack@n-api.service[61673]: X-Role: reader,admin,member Apr 14 18:51:24 user devstack@n-api.service[61673]: X-Roles: reader,admin,member Apr 14 18:51:24 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ea32fe1b14144a5889d4f9756ac49df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5ea32fe1b14144a5889d4f9756ac49df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5ea32fe1b14144a5889d4f9756ac49df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:51:24 user devstack@n-api.service[61673]: X-Tenant: tempest-VolumesAdminNegativeTest-1430126587 Apr 14 18:51:24 user devstack@n-api.service[61673]: X-Tenant-Id: 5ea32fe1b14144a5889d4f9756ac49df Apr 14 18:51:24 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1430126587 Apr 14 18:51:24 user devstack@n-api.service[61673]: X-User: tempest-VolumesAdminNegativeTest-1430126587-project-admin Apr 14 18:51:24 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 18:51:24 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 18:51:24 user devstack@n-api.service[61673]: X-User-Id: dd44410b3b5d4cb5a6c40843a37c21b2 Apr 14 18:51:24 user devstack@n-api.service[61673]: X-User-Name: tempest-VolumesAdminNegativeTest-1430126587-project-admin Apr 14 18:51:24 user devstack@n-api.service[61673]: Apr 14 18:51:24 user devstack@n-api.service[61673]: {"volumeAttachment": {"volumeId": "fcde2e44-66ca-4082-89b0-5ca91fdc35e6"}} Apr 14 18:51:24 user devstack@n-api.service[61673]: method: > Apr 14 18:51:24 user devstack@n-api.service[61673]: exception: Volume 6834a171-76e7-4c89-a5ea-fa288063fc1a could not be found. Apr 14 18:51:24 user devstack@n-api.service[61673]: action_args: {'server_id': '482b8c77-c963-4bc1-8e3c-847650736767', 'id': '6834a171-76e7-4c89-a5ea-fa288063fc1a', 'body': {'volumeAttachment': {'volumeId': 'fcde2e44-66ca-4082-89b0-5ca91fdc35e6'}}} Apr 14 18:51:24 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6834a171-76e7-4c89-a5ea-fa288063fc1a could not be found. (HTTP 404) (Request-ID: req-89fc2456-360c-447b-9bc8-0618c5d17a62) Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6834a171-76e7-4c89-a5ea-fa288063fc1a could not be found. Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6834a171-76e7-4c89-a5ea-fa288063fc1a could not be found. Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6834a171-76e7-4c89-a5ea-fa288063fc1a could not be found. Apr 14 18:51:24 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:51:24 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-9e51ffab-aa45-4570-a1ac-ca1d984a458e tempest-VolumesAdminNegativeTest-1430126587 tempest-VolumesAdminNegativeTest-1430126587-project-admin] Returning 404 to user: Volume 6834a171-76e7-4c89-a5ea-fa288063fc1a could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:51:24 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-9e51ffab-aa45-4570-a1ac-ca1d984a458e tempest-VolumesAdminNegativeTest-1430126587 tempest-VolumesAdminNegativeTest-1430126587-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/482b8c77-c963-4bc1-8e3c-847650736767/os-volume_attachments/6834a171-76e7-4c89-a5ea-fa288063fc1a" status: 404 len: 109 microversion: 2.1 time: 0.099642 Apr 14 18:51:24 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 117/354] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 18:51:24 2023] PUT /compute/v2.1/servers/482b8c77-c963-4bc1-8e3c-847650736767/os-volume_attachments/6834a171-76e7-4c89-a5ea-fa288063fc1a => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:51:24 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-17f23f96-49ab-4248-87d5-65fc689b2c7e tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:51:24 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-17f23f96-49ab-4248-87d5-65fc689b2c7e tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:51:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-17f23f96-49ab-4248-87d5-65fc689b2c7e tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-17f23f96-49ab-4248-87d5-65fc689b2c7e tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-17f23f96-49ab-4248-87d5-65fc689b2c7e tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-17f23f96-49ab-4248-87d5-65fc689b2c7e tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-17f23f96-49ab-4248-87d5-65fc689b2c7e tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-17f23f96-49ab-4248-87d5-65fc689b2c7e tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:25 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-17f23f96-49ab-4248-87d5-65fc689b2c7e tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee19795311144e69dd00db0403cb8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c49bffa4d8e4f92a54ad17a5f5db634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:51:25 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-17f23f96-49ab-4248-87d5-65fc689b2c7e tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ee19795311144e69dd00db0403cb8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c49bffa4d8e4f92a54ad17a5f5db634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:51:25 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-17f23f96-49ab-4248-87d5-65fc689b2c7e tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ee19795311144e69dd00db0403cb8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c49bffa4d8e4f92a54ad17a5f5db634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:51:25 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-17f23f96-49ab-4248-87d5-65fc689b2c7e tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc260db7-ffd6-4b7a-8b70-b4070478faab" status: 200 len: 2828 microversion: 2.42 time: 1.331687 Apr 14 18:51:25 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 121/355] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:51:24 2023] GET /compute/v2.1/servers/dc260db7-ffd6-4b7a-8b70-b4070478faab => generated 2828 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:51:27 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-a9105784-8392-4c93-847d-42028274bef8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Action: 'create', calling method: .version_select at 0x7fdae11ee170>, body: {"keypair": {"name": "tempest-keypair-1957519464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0U9FIo3XOjF6nYOtpXqE6JTO0lfoK8cuvWzthES49Nzff4NYIWc7KAGEhCpgBFjl3FZ9COcqUY5TUh5gsbwj+aRK/oLJ3yk94GFQmTSLPJ9Vd0arUl5Z9OdqqzV9kjBA=="}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:27 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-a9105784-8392-4c93-847d-42028274bef8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Getting quotas for project edf25bcc0dea4d3eb1284e8995eb3466. Resources: {'key_pairs'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:51:27 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-a9105784-8392-4c93-847d-42028274bef8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Getting quotas for user 9f90c8f23e3b42a98fdb9261db65f547 and project edf25bcc0dea4d3eb1284e8995eb3466. Resources: {'key_pairs'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:51:27 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-a9105784-8392-4c93-847d-42028274bef8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.123471 Apr 14 18:51:27 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 118/356] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 18:51:27 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:28 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:51:28 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:51:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:28 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Going to try to terminate instance {{(pid=61673) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 18:51:28 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/482b8c77-c963-4bc1-8e3c-847650736767" status: 204 len: 0 microversion: 2.1 time: 0.262214 Apr 14 18:51:28 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 118/357] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 18:51:28 2023] DELETE /compute/v2.1/servers/482b8c77-c963-4bc1-8e3c-847650736767 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 18:51:28 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-b739852f-139b-44cd-9aa8-82ec40efeb79 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:51:28 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-b739852f-139b-44cd-9aa8-82ec40efeb79 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:51:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b739852f-139b-44cd-9aa8-82ec40efeb79 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b739852f-139b-44cd-9aa8-82ec40efeb79 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b739852f-139b-44cd-9aa8-82ec40efeb79 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b739852f-139b-44cd-9aa8-82ec40efeb79 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b739852f-139b-44cd-9aa8-82ec40efeb79 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b739852f-139b-44cd-9aa8-82ec40efeb79 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:29 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-e61bda23-2f6f-4fad-b8a7-144c18961aaa req-d7a17c10-e4ef-4737-90e6-a828e5f8ee5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "482b8c77-c963-4bc1-8e3c-847650736767", "name": "network-vif-unplugged", "status": "completed", "tag": "38af2537-567f-4c06-b8f5-6e0c46f8dde6"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:29 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-e61bda23-2f6f-4fad-b8a7-144c18961aaa req-d7a17c10-e4ef-4737-90e6-a828e5f8ee5c service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:29 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-e61bda23-2f6f-4fad-b8a7-144c18961aaa req-d7a17c10-e4ef-4737-90e6-a828e5f8ee5c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:29 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-e61bda23-2f6f-4fad-b8a7-144c18961aaa req-d7a17c10-e4ef-4737-90e6-a828e5f8ee5c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:29 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-e61bda23-2f6f-4fad-b8a7-144c18961aaa req-d7a17c10-e4ef-4737-90e6-a828e5f8ee5c service nova] Creating event network-vif-unplugged:38af2537-567f-4c06-b8f5-6e0c46f8dde6 for instance 482b8c77-c963-4bc1-8e3c-847650736767 on user Apr 14 18:51:29 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-e61bda23-2f6f-4fad-b8a7-144c18961aaa req-d7a17c10-e4ef-4737-90e6-a828e5f8ee5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128489 Apr 14 18:51:29 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 119/358] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:51:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:29 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-b739852f-139b-44cd-9aa8-82ec40efeb79 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f78850ecd8042dbac5f24113b9df70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22a362d9cb946a99c203366f88baafb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:51:29 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-b739852f-139b-44cd-9aa8-82ec40efeb79 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/482b8c77-c963-4bc1-8e3c-847650736767" status: 200 len: 1499 microversion: 2.1 time: 0.662496 Apr 14 18:51:29 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 122/359] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:51:28 2023] GET /compute/v2.1/servers/482b8c77-c963-4bc1-8e3c-847650736767 => generated 1499 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 18:51:31 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1892211249", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "05575fea-953f-4063-8670-e146f7767b37"}], "security_groups": [{"name": "tempest-securitygroup--589553482"}], "key_name": "tempest-keypair-1957519464", "user_data": "}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:31 user devstack@n-api.service[61673]: DEBUG nova.network.neutron [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] validate_networks() for [('05575fea-953f-4063-8670-e146f7767b37', None, None, None, None, None)] {{(pid=61673) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:51:31 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-ac1e99b8-a620-4087-b6c7-56735931243a req-df936c1e-8a55-457c-8833-67829344ba5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "482b8c77-c963-4bc1-8e3c-847650736767", "name": "network-vif-plugged", "status": "completed", "tag": "38af2537-567f-4c06-b8f5-6e0c46f8dde6"}, {"server_uuid": "482b8c77-c963-4bc1-8e3c-847650736767", "name": "network-vif-deleted", "tag": "38af2537-567f-4c06-b8f5-6e0c46f8dde6"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-ac1e99b8-a620-4087-b6c7-56735931243a req-df936c1e-8a55-457c-8833-67829344ba5e service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-ac1e99b8-a620-4087-b6c7-56735931243a req-df936c1e-8a55-457c-8833-67829344ba5e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-ac1e99b8-a620-4087-b6c7-56735931243a req-df936c1e-8a55-457c-8833-67829344ba5e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:31 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-ac1e99b8-a620-4087-b6c7-56735931243a req-df936c1e-8a55-457c-8833-67829344ba5e service nova] Creating event network-vif-plugged:38af2537-567f-4c06-b8f5-6e0c46f8dde6 for instance 482b8c77-c963-4bc1-8e3c-847650736767 on user Apr 14 18:51:31 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-ac1e99b8-a620-4087-b6c7-56735931243a req-df936c1e-8a55-457c-8833-67829344ba5e service nova] Creating event network-vif-deleted:38af2537-567f-4c06-b8f5-6e0c46f8dde6 for instance 482b8c77-c963-4bc1-8e3c-847650736767 on user Apr 14 18:51:31 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-ac1e99b8-a620-4087-b6c7-56735931243a req-df936c1e-8a55-457c-8833-67829344ba5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034273 Apr 14 18:51:31 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 120/360] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:51:31 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:31 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Flavor limits 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:51:31 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Image limits 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:51:31 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Flavor pref 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:51:31 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Image pref 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:51:31 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:51:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:31 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Getting quotas for project edf25bcc0dea4d3eb1284e8995eb3466. Resources: {'ram', 'instances', 'cores'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:51:31 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Getting quotas for user 9f90c8f23e3b42a98fdb9261db65f547 and project edf25bcc0dea4d3eb1284e8995eb3466. Resources: {'ram', 'instances', 'cores'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:51:31 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Going to run 1 instances... {{(pid=61673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:51:31 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:51:31 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.809258 Apr 14 18:51:31 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 119/361] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:51:31 2023] POST /compute/v2.1/servers => generated 399 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:51:31 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-466d14a6-8097-4788-b93e-49c321a0e76b tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:51:31 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-466d14a6-8097-4788-b93e-49c321a0e76b tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:51:31 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-466d14a6-8097-4788-b93e-49c321a0e76b tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f90c8f23e3b42a98fdb9261db65f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf25bcc0dea4d3eb1284e8995eb3466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:51:31 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-466d14a6-8097-4788-b93e-49c321a0e76b tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4" status: 200 len: 1232 microversion: 2.1 time: 0.070301 Apr 14 18:51:31 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 123/362] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:51:31 2023] GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4 => generated 1232 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:51:35 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-33863740-7d68-40d4-a9dc-21f5f1ee9426 req-091b1d54-0a29-42b1-98ba-5af36eacb072 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0050e6bb-0b53-4fdc-8437-16b94ee79fa4", "tag": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:35 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-33863740-7d68-40d4-a9dc-21f5f1ee9426 req-091b1d54-0a29-42b1-98ba-5af36eacb072 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:35 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-33863740-7d68-40d4-a9dc-21f5f1ee9426 req-091b1d54-0a29-42b1-98ba-5af36eacb072 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:35 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-33863740-7d68-40d4-a9dc-21f5f1ee9426 req-091b1d54-0a29-42b1-98ba-5af36eacb072 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:35 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-33863740-7d68-40d4-a9dc-21f5f1ee9426 req-091b1d54-0a29-42b1-98ba-5af36eacb072 service nova] Creating event network-changed:2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 on user Apr 14 18:51:35 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-33863740-7d68-40d4-a9dc-21f5f1ee9426 req-091b1d54-0a29-42b1-98ba-5af36eacb072 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058494 Apr 14 18:51:35 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 121/363] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:51:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:38 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-0d2e79de-57d9-4174-b828-c076e8970fd8 req-288f9230-04ae-499a-bfbb-69d98f22651a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0050e6bb-0b53-4fdc-8437-16b94ee79fa4", "name": "network-vif-plugged", "status": "completed", "tag": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:38 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-0d2e79de-57d9-4174-b828-c076e8970fd8 req-288f9230-04ae-499a-bfbb-69d98f22651a service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:38 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-0d2e79de-57d9-4174-b828-c076e8970fd8 req-288f9230-04ae-499a-bfbb-69d98f22651a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:38 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-0d2e79de-57d9-4174-b828-c076e8970fd8 req-288f9230-04ae-499a-bfbb-69d98f22651a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:38 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-0d2e79de-57d9-4174-b828-c076e8970fd8 req-288f9230-04ae-499a-bfbb-69d98f22651a service nova] Creating event network-vif-plugged:2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 on user Apr 14 18:51:38 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-0d2e79de-57d9-4174-b828-c076e8970fd8 req-288f9230-04ae-499a-bfbb-69d98f22651a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.370324 Apr 14 18:51:38 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 120/364] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:51:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:39 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=33 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:51:39 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-7d780b71-e4ef-4f4f-8c10-ace63d61325e tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Action: 'create', calling method: .version_select at 0x7fdae10228c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-756134745", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBx6ahRgtQXPgUyewJCWpWITHQipTZzs9c0P8Aj7ZCbMBMa2yXyDTXsh+XmK3wGceblEWwvvTYvKODXsclHUqQnjkGng7EfdTyYzxpc1qTSqvnJNTDFtuZ+jiMrT7Wx64g=="}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:39 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=20 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:51:39 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-7d780b71-e4ef-4f4f-8c10-ace63d61325e tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Getting quotas for project 46d0091007734312b8d33caf294d2c65. Resources: {'key_pairs'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:51:39 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-7d780b71-e4ef-4f4f-8c10-ace63d61325e tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Getting quotas for user 10e3f2dda9bc49f48c66beb978dbdaca and project 46d0091007734312b8d33caf294d2c65. Resources: {'key_pairs'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:51:39 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-7d780b71-e4ef-4f4f-8c10-ace63d61325e tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.156338 Apr 14 18:51:39 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 124/365] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 18:51:39 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:40 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-1ba9914a-4457-4d75-a2f3-80602406f86d req-31fd3733-68d1-4bdc-bf4d-bc4a08b14b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0050e6bb-0b53-4fdc-8437-16b94ee79fa4", "name": "network-vif-plugged", "status": "completed", "tag": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:40 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=4 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:51:40 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:51:40 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-1ba9914a-4457-4d75-a2f3-80602406f86d req-31fd3733-68d1-4bdc-bf4d-bc4a08b14b70 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:40 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-1ba9914a-4457-4d75-a2f3-80602406f86d req-31fd3733-68d1-4bdc-bf4d-bc4a08b14b70 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:40 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-1ba9914a-4457-4d75-a2f3-80602406f86d req-31fd3733-68d1-4bdc-bf4d-bc4a08b14b70 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:40 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=22 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:51:40 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-1ba9914a-4457-4d75-a2f3-80602406f86d req-31fd3733-68d1-4bdc-bf4d-bc4a08b14b70 service nova] Creating event network-vif-plugged:2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 on user Apr 14 18:51:40 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-1ba9914a-4457-4d75-a2f3-80602406f86d req-31fd3733-68d1-4bdc-bf4d-bc4a08b14b70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046091 Apr 14 18:51:40 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 122/366] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:51:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:42 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:51:42 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=6 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:51:42 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-cb93882d-3b65-4f8c-a284-a2defc7065d2 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:51:42 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-cb93882d-3b65-4f8c-a284-a2defc7065d2 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:51:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-cb93882d-3b65-4f8c-a284-a2defc7065d2 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-cb93882d-3b65-4f8c-a284-a2defc7065d2 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-cb93882d-3b65-4f8c-a284-a2defc7065d2 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-cb93882d-3b65-4f8c-a284-a2defc7065d2 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-cb93882d-3b65-4f8c-a284-a2defc7065d2 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-cb93882d-3b65-4f8c-a284-a2defc7065d2 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:42 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-cb93882d-3b65-4f8c-a284-a2defc7065d2 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:51:42 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-cb93882d-3b65-4f8c-a284-a2defc7065d2 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:51:42 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-cb93882d-3b65-4f8c-a284-a2defc7065d2 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:51:42 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-cb93882d-3b65-4f8c-a284-a2defc7065d2 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23d14a51-41aa-4827-bd60-c605d9689bc8" status: 200 len: 1754 microversion: 2.87 time: 0.388849 Apr 14 18:51:42 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 121/367] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:51:42 2023] GET /compute/v2.1/servers/23d14a51-41aa-4827-bd60-c605d9689bc8 => generated 1754 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:51:43 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-9fd62b7c-6c0e-4a16-b93e-2c37f7229272 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:51:43 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-9fd62b7c-6c0e-4a16-b93e-2c37f7229272 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:51:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-9fd62b7c-6c0e-4a16-b93e-2c37f7229272 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-9fd62b7c-6c0e-4a16-b93e-2c37f7229272 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-9fd62b7c-6c0e-4a16-b93e-2c37f7229272 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-9fd62b7c-6c0e-4a16-b93e-2c37f7229272 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-9fd62b7c-6c0e-4a16-b93e-2c37f7229272 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-9fd62b7c-6c0e-4a16-b93e-2c37f7229272 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:43 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-9fd62b7c-6c0e-4a16-b93e-2c37f7229272 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3f788e144c46e7bdf6f4fe3a5aeb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95319509fb6a4e58998703975370877a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:51:43 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-9fd62b7c-6c0e-4a16-b93e-2c37f7229272 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1285eca2-575b-4550-a424-605fb186b510" status: 200 len: 1496 microversion: 2.1 time: 0.305093 Apr 14 18:51:43 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 125/368] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:51:43 2023] GET /compute/v2.1/servers/1285eca2-575b-4550-a424-605fb186b510 => generated 1496 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:51:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-268762116", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-756134745", "security_groups": [{"name": "tempest-secgroup-smoke-1394781019"}], "networks": [{"uuid": "05de5351-3bd0-4050-a14a-321e2749ca5d"}], "block_device_mapping_v2": [{"uuid": "bbbfd96c-e671-4f85-8956-985a620429f4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:46 user devstack@n-api.service[61675]: DEBUG nova.network.neutron [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] validate_networks() for [('05de5351-3bd0-4050-a14a-321e2749ca5d', None, None, None, None, None)] {{(pid=61675) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:51:46 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Flavor limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:51:46 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Image limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:51:46 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Flavor pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:51:46 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Image pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:51:46 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:51:47 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:47 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:47 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:47 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:47 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:47 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:47 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Getting quotas for project 46d0091007734312b8d33caf294d2c65. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:51:47 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Getting quotas for user 10e3f2dda9bc49f48c66beb978dbdaca and project 46d0091007734312b8d33caf294d2c65. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:51:47 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Going to run 1 instances... {{(pid=61675) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:51:47 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bbbfd96c-e671-4f85-8956-985a620429f4',volume_size=None,volume_type=None)] {{(pid=61675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:51:47 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.930639 Apr 14 18:51:47 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 123/369] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:51:46 2023] POST /compute/v2.1/servers => generated 404 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:51:47 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-cd9d28fd-713e-4c11-86a5-084f65ffca6e tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:51:47 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-cd9d28fd-713e-4c11-86a5-084f65ffca6e tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:51:47 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-cd9d28fd-713e-4c11-86a5-084f65ffca6e tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e3f2dda9bc49f48c66beb978dbdaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0091007734312b8d33caf294d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:51:47 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-cd9d28fd-713e-4c11-86a5-084f65ffca6e tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2a860bd-802f-4760-b77b-92b7ac4ad09b" status: 200 len: 1082 microversion: 2.1 time: 0.078422 Apr 14 18:51:47 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 122/370] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:51:47 2023] GET /compute/v2.1/servers/a2a860bd-802f-4760-b77b-92b7ac4ad09b => generated 1082 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:51:50 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-bf5edf27-1a88-4783-87d1-d2f5c0492331 req-9613ee4f-7224-4eaa-bd85-17a0f711c73c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a860bd-802f-4760-b77b-92b7ac4ad09b", "tag": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:50 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=6 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:51:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-bf5edf27-1a88-4783-87d1-d2f5c0492331 req-9613ee4f-7224-4eaa-bd85-17a0f711c73c service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-bf5edf27-1a88-4783-87d1-d2f5c0492331 req-9613ee4f-7224-4eaa-bd85-17a0f711c73c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-bf5edf27-1a88-4783-87d1-d2f5c0492331 req-9613ee4f-7224-4eaa-bd85-17a0f711c73c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:50 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-bf5edf27-1a88-4783-87d1-d2f5c0492331 req-9613ee4f-7224-4eaa-bd85-17a0f711c73c service nova] Creating event network-changed:ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 for instance a2a860bd-802f-4760-b77b-92b7ac4ad09b on user Apr 14 18:51:50 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-bf5edf27-1a88-4783-87d1-d2f5c0492331 req-9613ee4f-7224-4eaa-bd85-17a0f711c73c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056500 Apr 14 18:51:50 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 126/371] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:51:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:50 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-fd6417f0-cff0-415d-864b-5caf24dfe5ac tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:51:50 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-fd6417f0-cff0-415d-864b-5caf24dfe5ac tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:51:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fd6417f0-cff0-415d-864b-5caf24dfe5ac tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fd6417f0-cff0-415d-864b-5caf24dfe5ac tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fd6417f0-cff0-415d-864b-5caf24dfe5ac tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fd6417f0-cff0-415d-864b-5caf24dfe5ac tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fd6417f0-cff0-415d-864b-5caf24dfe5ac tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fd6417f0-cff0-415d-864b-5caf24dfe5ac tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:50 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-fd6417f0-cff0-415d-864b-5caf24dfe5ac tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058263 Apr 14 18:51:50 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 124/372] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:51:50 2023] GET /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 18:51:50 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:51:50 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:51:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:51 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Going to try to terminate instance {{(pid=61673) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 18:51:51 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c" status: 204 len: 0 microversion: 2.1 time: 0.118992 Apr 14 18:51:51 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 123/373] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 18:51:50 2023] DELETE /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 18:51:51 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-e21241bd-fc6d-4038-adab-7cb79663985c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:51:51 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-e21241bd-fc6d-4038-adab-7cb79663985c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:51:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e21241bd-fc6d-4038-adab-7cb79663985c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e21241bd-fc6d-4038-adab-7cb79663985c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e21241bd-fc6d-4038-adab-7cb79663985c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e21241bd-fc6d-4038-adab-7cb79663985c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e21241bd-fc6d-4038-adab-7cb79663985c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e21241bd-fc6d-4038-adab-7cb79663985c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:51 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-962de664-5424-471f-b990-f1fa6e682802 req-74eaa392-30d6-4df1-9aa9-2287b5d9061d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094a4a33-569e-4137-8798-743499f1046c", "name": "network-vif-unplugged", "status": "completed", "tag": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:51 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-962de664-5424-471f-b990-f1fa6e682802 req-74eaa392-30d6-4df1-9aa9-2287b5d9061d service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:51 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-962de664-5424-471f-b990-f1fa6e682802 req-74eaa392-30d6-4df1-9aa9-2287b5d9061d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:51 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-962de664-5424-471f-b990-f1fa6e682802 req-74eaa392-30d6-4df1-9aa9-2287b5d9061d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:51 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-962de664-5424-471f-b990-f1fa6e682802 req-74eaa392-30d6-4df1-9aa9-2287b5d9061d service nova] Creating event network-vif-unplugged:940c6edd-6fc7-4e88-92b4-38a62e88f2ab for instance 094a4a33-569e-4137-8798-743499f1046c on user Apr 14 18:51:51 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-962de664-5424-471f-b990-f1fa6e682802 req-74eaa392-30d6-4df1-9aa9-2287b5d9061d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046706 Apr 14 18:51:51 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 125/374] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:51:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:51 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-e21241bd-fc6d-4038-adab-7cb79663985c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d53edaffb8f4038abd366d7942c6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34cdebcd7154988a957deae140e8eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:51:51 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-e21241bd-fc6d-4038-adab-7cb79663985c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c" status: 200 len: 1668 microversion: 2.1 time: 0.488864 Apr 14 18:51:51 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 127/375] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:51:51 2023] GET /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c => generated 1668 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:51:53 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-262e4c27-3ce6-4db7-9b74-56159b85487b req-4899aa73-522d-4eb8-86e3-e3af2dfb5413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094a4a33-569e-4137-8798-743499f1046c", "name": "network-vif-deleted", "tag": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:53 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:51:53 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-262e4c27-3ce6-4db7-9b74-56159b85487b req-4899aa73-522d-4eb8-86e3-e3af2dfb5413 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:53 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-262e4c27-3ce6-4db7-9b74-56159b85487b req-4899aa73-522d-4eb8-86e3-e3af2dfb5413 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:53 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-262e4c27-3ce6-4db7-9b74-56159b85487b req-4899aa73-522d-4eb8-86e3-e3af2dfb5413 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:53 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:51:53 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-262e4c27-3ce6-4db7-9b74-56159b85487b req-4899aa73-522d-4eb8-86e3-e3af2dfb5413 service nova] Creating event network-vif-deleted:940c6edd-6fc7-4e88-92b4-38a62e88f2ab for instance 094a4a33-569e-4137-8798-743499f1046c on user Apr 14 18:51:53 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-262e4c27-3ce6-4db7-9b74-56159b85487b req-4899aa73-522d-4eb8-86e3-e3af2dfb5413 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046243 Apr 14 18:51:53 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 124/376] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:51:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:53 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-172cee56-aaa2-4d55-a7a9-75ffb73ccb7f req-ae1e0bab-66a2-4a49-89f6-ce78173ec0b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094a4a33-569e-4137-8798-743499f1046c", "name": "network-vif-plugged", "status": "completed", "tag": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:53 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-172cee56-aaa2-4d55-a7a9-75ffb73ccb7f req-ae1e0bab-66a2-4a49-89f6-ce78173ec0b4 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:53 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-172cee56-aaa2-4d55-a7a9-75ffb73ccb7f req-ae1e0bab-66a2-4a49-89f6-ce78173ec0b4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:53 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-172cee56-aaa2-4d55-a7a9-75ffb73ccb7f req-ae1e0bab-66a2-4a49-89f6-ce78173ec0b4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:53 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-172cee56-aaa2-4d55-a7a9-75ffb73ccb7f req-ae1e0bab-66a2-4a49-89f6-ce78173ec0b4 service nova] Creating event network-vif-plugged:940c6edd-6fc7-4e88-92b4-38a62e88f2ab for instance 094a4a33-569e-4137-8798-743499f1046c on user Apr 14 18:51:53 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-172cee56-aaa2-4d55-a7a9-75ffb73ccb7f req-ae1e0bab-66a2-4a49-89f6-ce78173ec0b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029158 Apr 14 18:51:53 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 126/377] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:51:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:57 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-f3942fde-1705-4be8-9179-6b9e85338d8c req-6f324471-a15d-47eb-b4c9-a40d74e5edbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a860bd-802f-4760-b77b-92b7ac4ad09b", "name": "network-vif-plugged", "status": "completed", "tag": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:57 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-f3942fde-1705-4be8-9179-6b9e85338d8c req-6f324471-a15d-47eb-b4c9-a40d74e5edbe service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:57 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-f3942fde-1705-4be8-9179-6b9e85338d8c req-6f324471-a15d-47eb-b4c9-a40d74e5edbe service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:57 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-f3942fde-1705-4be8-9179-6b9e85338d8c req-6f324471-a15d-47eb-b4c9-a40d74e5edbe service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:57 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-f3942fde-1705-4be8-9179-6b9e85338d8c req-6f324471-a15d-47eb-b4c9-a40d74e5edbe service nova] Creating event network-vif-plugged:ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 for instance a2a860bd-802f-4760-b77b-92b7ac4ad09b on user Apr 14 18:51:57 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-f3942fde-1705-4be8-9179-6b9e85338d8c req-6f324471-a15d-47eb-b4c9-a40d74e5edbe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052594 Apr 14 18:51:57 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 128/378] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:51:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:51:59 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-c1489cc6-5ef9-4df3-a97e-e0ff55a628a9 req-a8a029ba-ba2f-43f2-9681-9ac67e318142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a860bd-802f-4760-b77b-92b7ac4ad09b", "name": "network-vif-plugged", "status": "completed", "tag": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:51:59 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:51:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-c1489cc6-5ef9-4df3-a97e-e0ff55a628a9 req-a8a029ba-ba2f-43f2-9681-9ac67e318142 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:51:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-c1489cc6-5ef9-4df3-a97e-e0ff55a628a9 req-a8a029ba-ba2f-43f2-9681-9ac67e318142 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:51:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-c1489cc6-5ef9-4df3-a97e-e0ff55a628a9 req-a8a029ba-ba2f-43f2-9681-9ac67e318142 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:51:59 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-c1489cc6-5ef9-4df3-a97e-e0ff55a628a9 req-a8a029ba-ba2f-43f2-9681-9ac67e318142 service nova] Creating event network-vif-plugged:ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 for instance a2a860bd-802f-4760-b77b-92b7ac4ad09b on user Apr 14 18:51:59 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-c1489cc6-5ef9-4df3-a97e-e0ff55a628a9 req-a8a029ba-ba2f-43f2-9681-9ac67e318142 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030496 Apr 14 18:51:59 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 125/379] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:51:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:00 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:52:00 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=6 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:52:01 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-f13f1900-86a6-4fc8-a83e-9bfb266586f9 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:01 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-f13f1900-86a6-4fc8-a83e-9bfb266586f9 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f13f1900-86a6-4fc8-a83e-9bfb266586f9 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f13f1900-86a6-4fc8-a83e-9bfb266586f9 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f13f1900-86a6-4fc8-a83e-9bfb266586f9 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f13f1900-86a6-4fc8-a83e-9bfb266586f9 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f13f1900-86a6-4fc8-a83e-9bfb266586f9 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f13f1900-86a6-4fc8-a83e-9bfb266586f9 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:01 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-f13f1900-86a6-4fc8-a83e-9bfb266586f9 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c/action" status: 202 len: 0 microversion: 2.1 time: 0.282328 Apr 14 18:52:01 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 127/380] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 18:52:00 2023] POST /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:52:01 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-11a0e14b-85b7-4abb-b9f9-c1a033ec0d55 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:52:01 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-11a0e14b-85b7-4abb-b9f9-c1a033ec0d55 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-11a0e14b-85b7-4abb-b9f9-c1a033ec0d55 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-11a0e14b-85b7-4abb-b9f9-c1a033ec0d55 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-11a0e14b-85b7-4abb-b9f9-c1a033ec0d55 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-11a0e14b-85b7-4abb-b9f9-c1a033ec0d55 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-11a0e14b-85b7-4abb-b9f9-c1a033ec0d55 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-11a0e14b-85b7-4abb-b9f9-c1a033ec0d55 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:01 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-11a0e14b-85b7-4abb-b9f9-c1a033ec0d55 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.213110 Apr 14 18:52:01 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 129/381] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 18:52:01 2023] GET /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c/os-interface => generated 282 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:02 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-afa68d5e-787c-4cb4-8f3d-0b5c9b7e2c15 req-ef517a61-507b-48f2-b310-d5ce61a5c510 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e55c721-9fad-4478-9e74-e87d0c95bc3c", "tag": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-afa68d5e-787c-4cb4-8f3d-0b5c9b7e2c15 req-ef517a61-507b-48f2-b310-d5ce61a5c510 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-afa68d5e-787c-4cb4-8f3d-0b5c9b7e2c15 req-ef517a61-507b-48f2-b310-d5ce61a5c510 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-afa68d5e-787c-4cb4-8f3d-0b5c9b7e2c15 req-ef517a61-507b-48f2-b310-d5ce61a5c510 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:02 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-afa68d5e-787c-4cb4-8f3d-0b5c9b7e2c15 req-ef517a61-507b-48f2-b310-d5ce61a5c510 service nova] Creating event network-changed:66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c on user Apr 14 18:52:02 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-afa68d5e-787c-4cb4-8f3d-0b5c9b7e2c15 req-ef517a61-507b-48f2-b310-d5ce61a5c510 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055163 Apr 14 18:52:02 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 126/382] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:52:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:04 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e55c721-9fad-4478-9e74-e87d0c95bc3c", "tag": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3"}, {"server_uuid": "8e55c721-9fad-4478-9e74-e87d0c95bc3c", "name": "network-vif-unplugged", "status": "completed", "tag": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3"}, {"server_uuid": "8e55c721-9fad-4478-9e74-e87d0c95bc3c", "name": "network-vif-plugged", "status": "completed", "tag": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:04 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] Creating event network-changed:66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c on user Apr 14 18:52:04 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] Creating event network-vif-unplugged:66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c on user Apr 14 18:52:04 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] Creating event network-vif-plugged:66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c on user Apr 14 18:52:04 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.088922 Apr 14 18:52:04 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 128/383] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:52:04 2023] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:06 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-c2e0cffd-6b7f-4808-b829-8d7f2cd195c2 req-d65a7ed8-29f6-430a-8fbb-edb4c489de27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e55c721-9fad-4478-9e74-e87d0c95bc3c", "name": "network-vif-plugged", "status": "completed", "tag": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3"}, {"server_uuid": "8e55c721-9fad-4478-9e74-e87d0c95bc3c", "name": "network-vif-plugged", "status": "completed", "tag": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-c2e0cffd-6b7f-4808-b829-8d7f2cd195c2 req-d65a7ed8-29f6-430a-8fbb-edb4c489de27 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-c2e0cffd-6b7f-4808-b829-8d7f2cd195c2 req-d65a7ed8-29f6-430a-8fbb-edb4c489de27 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-c2e0cffd-6b7f-4808-b829-8d7f2cd195c2 req-d65a7ed8-29f6-430a-8fbb-edb4c489de27 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:06 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-c2e0cffd-6b7f-4808-b829-8d7f2cd195c2 req-d65a7ed8-29f6-430a-8fbb-edb4c489de27 service nova] Creating event network-vif-plugged:66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c on user Apr 14 18:52:06 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-c2e0cffd-6b7f-4808-b829-8d7f2cd195c2 req-d65a7ed8-29f6-430a-8fbb-edb4c489de27 service nova] Creating event network-vif-plugged:66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c on user Apr 14 18:52:06 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-c2e0cffd-6b7f-4808-b829-8d7f2cd195c2 req-d65a7ed8-29f6-430a-8fbb-edb4c489de27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035421 Apr 14 18:52:06 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 130/384] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:52:06 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:12 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=5 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:52:12 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=5 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:52:12 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-782f3246-d4cf-4c8e-83b0-f3df2d6d5965 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:52:12 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-782f3246-d4cf-4c8e-83b0-f3df2d6d5965 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:12 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-782f3246-d4cf-4c8e-83b0-f3df2d6d5965 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:12 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-782f3246-d4cf-4c8e-83b0-f3df2d6d5965 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:12 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-782f3246-d4cf-4c8e-83b0-f3df2d6d5965 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:12 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-782f3246-d4cf-4c8e-83b0-f3df2d6d5965 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:12 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-782f3246-d4cf-4c8e-83b0-f3df2d6d5965 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:12 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-782f3246-d4cf-4c8e-83b0-f3df2d6d5965 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:13 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-782f3246-d4cf-4c8e-83b0-f3df2d6d5965 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.300159 Apr 14 18:52:13 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 127/385] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:52:12 2023] GET /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae/os-volume_attachments => generated 25 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 18:52:13 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-b464077a-2f81-4892-9bcd-791162d7114e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:52:13 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-b464077a-2f81-4892-9bcd-791162d7114e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:13 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:52:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b464077a-2f81-4892-9bcd-791162d7114e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b464077a-2f81-4892-9bcd-791162d7114e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b464077a-2f81-4892-9bcd-791162d7114e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b464077a-2f81-4892-9bcd-791162d7114e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b464077a-2f81-4892-9bcd-791162d7114e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b464077a-2f81-4892-9bcd-791162d7114e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:13 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-b464077a-2f81-4892-9bcd-791162d7114e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] HTTP exception thrown: Instance 656b9f90-ce93-42cd-aa1b-3ff868162aae is not attached to volume 31ad3520-e4ab-4564-8a4f-b1f9afc6d344 Apr 14 18:52:13 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-b464077a-2f81-4892-9bcd-791162d7114e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Request method failure captured: Apr 14 18:52:13 user devstack@n-api.service[61675]: request: DELETE /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae/os-volume_attachments/31ad3520-e4ab-4564-8a4f-b1f9afc6d344 HTTP/1.1 Apr 14 18:52:13 user devstack@n-api.service[61675]: Accept: application/json Apr 14 18:52:13 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 18:52:13 user devstack@n-api.service[61675]: Connection: close Apr 14 18:52:13 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 18:52:13 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 18:52:13 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 18:52:13 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 18:52:13 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 18:52:13 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOZ-jF2atbHM_lByU_PslMtdO0A0nVkr7kGVuQAm-akNwPFZSgKmoKfwLoWEfhrr5QMF2UgTOk5rIvzWw8k8iAfboO82nc4PwBwFuYK77brK2jiwQR--r0qVPIH2UN3sU9b27IssfwfkZMWqxZA_2E94J7fiHrT6oOA1O-1dwGEm2pZM Apr 14 18:52:13 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 18:52:13 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 18:52:13 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 18:52:13 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 18:52:13 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 18:52:13 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 18:52:13 user devstack@n-api.service[61675]: X-Project-Id: 8e6b4e98cf9e4f96b79c3288dfe0da89 Apr 14 18:52:13 user devstack@n-api.service[61675]: X-Project-Name: tempest-TestMinimumBasicScenario-1257841115 Apr 14 18:52:13 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 18:52:13 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 18:52:13 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8e6b4e98cf9e4f96b79c3288dfe0da89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8e6b4e98cf9e4f96b79c3288dfe0da89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8e6b4e98cf9e4f96b79c3288dfe0da89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:52:13 user devstack@n-api.service[61675]: X-Tenant: tempest-TestMinimumBasicScenario-1257841115 Apr 14 18:52:13 user devstack@n-api.service[61675]: X-Tenant-Id: 8e6b4e98cf9e4f96b79c3288dfe0da89 Apr 14 18:52:13 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1257841115 Apr 14 18:52:13 user devstack@n-api.service[61675]: X-User: tempest-TestMinimumBasicScenario-1257841115-project-member Apr 14 18:52:13 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 18:52:13 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 18:52:13 user devstack@n-api.service[61675]: X-User-Id: 67e1d31c2d9048699758779dedf7d3ac Apr 14 18:52:13 user devstack@n-api.service[61675]: X-User-Name: tempest-TestMinimumBasicScenario-1257841115-project-member Apr 14 18:52:13 user devstack@n-api.service[61675]: method: > Apr 14 18:52:13 user devstack@n-api.service[61675]: exception: Instance 656b9f90-ce93-42cd-aa1b-3ff868162aae is not attached to volume 31ad3520-e4ab-4564-8a4f-b1f9afc6d344 Apr 14 18:52:13 user devstack@n-api.service[61675]: action_args: {'server_id': '656b9f90-ce93-42cd-aa1b-3ff868162aae', 'id': '31ad3520-e4ab-4564-8a4f-b1f9afc6d344'} Apr 14 18:52:13 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 31ad3520-e4ab-4564-8a4f-b1f9afc6d344. Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 656b9f90-ce93-42cd-aa1b-3ff868162aae is not attached to volume 31ad3520-e4ab-4564-8a4f-b1f9afc6d344 Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 656b9f90-ce93-42cd-aa1b-3ff868162aae is not attached to volume 31ad3520-e4ab-4564-8a4f-b1f9afc6d344 Apr 14 18:52:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:52:13 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-b464077a-2f81-4892-9bcd-791162d7114e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Returning 404 to user: Instance 656b9f90-ce93-42cd-aa1b-3ff868162aae is not attached to volume 31ad3520-e4ab-4564-8a4f-b1f9afc6d344 {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:52:13 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-b464077a-2f81-4892-9bcd-791162d7114e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae/os-volume_attachments/31ad3520-e4ab-4564-8a4f-b1f9afc6d344" status: 404 len: 154 microversion: 2.1 time: 0.111966 Apr 14 18:52:13 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 129/386] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 18:52:13 2023] DELETE /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae/os-volume_attachments/31ad3520-e4ab-4564-8a4f-b1f9afc6d344 => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:52:13 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:13 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:13 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:52:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:13 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=23 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:52:13 user devstack@n-api.service[61674]: DEBUG nova.objects.instance [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'flavor' on Instance uuid cf640f3e-3d77-46ee-8a11-e0bdc870ff97 {{(pid=61674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 18:52:13 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/action" status: 200 len: 32 microversion: 2.1 time: 0.171424 Apr 14 18:52:13 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 131/387] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 18:52:13 2023] POST /compute/v2.1/servers/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/action => generated 32 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 18:52:13 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-264c6a1a-b217-47fa-a131-b0784da4c2ff tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:52:13 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-264c6a1a-b217-47fa-a131-b0784da4c2ff tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-264c6a1a-b217-47fa-a131-b0784da4c2ff tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-264c6a1a-b217-47fa-a131-b0784da4c2ff tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-264c6a1a-b217-47fa-a131-b0784da4c2ff tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-264c6a1a-b217-47fa-a131-b0784da4c2ff tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-264c6a1a-b217-47fa-a131-b0784da4c2ff tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-264c6a1a-b217-47fa-a131-b0784da4c2ff tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:13 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-264c6a1a-b217-47fa-a131-b0784da4c2ff tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8713ed85ffb4446847f5ded4bc2e399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60e8abd123e414f847c68ba72894689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:52:13 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-264c6a1a-b217-47fa-a131-b0784da4c2ff tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf640f3e-3d77-46ee-8a11-e0bdc870ff97" status: 200 len: 1509 microversion: 2.1 time: 0.290352 Apr 14 18:52:13 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 128/388] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:52:13 2023] GET /compute/v2.1/servers/cf640f3e-3d77-46ee-8a11-e0bdc870ff97 => generated 1509 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:52:14 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-031f8266-da4e-4945-92ec-7f2aa358aec4 req-12578d9b-96fb-4dce-99a0-a4dbdabc835b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf640f3e-3d77-46ee-8a11-e0bdc870ff97", "name": "network-vif-unplugged", "status": "completed", "tag": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-031f8266-da4e-4945-92ec-7f2aa358aec4 req-12578d9b-96fb-4dce-99a0-a4dbdabc835b service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-031f8266-da4e-4945-92ec-7f2aa358aec4 req-12578d9b-96fb-4dce-99a0-a4dbdabc835b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-031f8266-da4e-4945-92ec-7f2aa358aec4 req-12578d9b-96fb-4dce-99a0-a4dbdabc835b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:14 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-031f8266-da4e-4945-92ec-7f2aa358aec4 req-12578d9b-96fb-4dce-99a0-a4dbdabc835b service nova] Creating event network-vif-unplugged:ee0e2f74-c744-41ec-b3f8-c7d124c61f8e for instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 on user Apr 14 18:52:14 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-031f8266-da4e-4945-92ec-7f2aa358aec4 req-12578d9b-96fb-4dce-99a0-a4dbdabc835b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054495 Apr 14 18:52:14 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 130/389] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:52:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:15 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:52:15 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:15 user devstack@n-api.service[61674]: DEBUG nova.objects.instance [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'services' on Instance uuid aa09363f-435d-4fa8-9f11-db0c3f4e08be {{(pid=61674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 18:52:15 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be/os-volume_attachments/ced25197-205e-4821-82f2-1f37e41f5993" status: 202 len: 0 microversion: 2.1 time: 0.215110 Apr 14 18:52:15 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 132/390] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 18:52:15 2023] DELETE /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be/os-volume_attachments/ced25197-205e-4821-82f2-1f37e41f5993 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:52:15 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-99857cab-0213-4ead-ae17-591a4ae7cc4c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:52:15 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-99857cab-0213-4ead-ae17-591a4ae7cc4c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:15 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-99857cab-0213-4ead-ae17-591a4ae7cc4c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:15 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-99857cab-0213-4ead-ae17-591a4ae7cc4c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:15 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-99857cab-0213-4ead-ae17-591a4ae7cc4c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:15 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-99857cab-0213-4ead-ae17-591a4ae7cc4c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:15 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-99857cab-0213-4ead-ae17-591a4ae7cc4c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:15 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-99857cab-0213-4ead-ae17-591a4ae7cc4c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:15 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-99857cab-0213-4ead-ae17-591a4ae7cc4c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080961 Apr 14 18:52:15 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 129/391] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:52:15 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:16 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-94a99047-556d-451e-8aac-cd86efeab7c7 req-bc32cd10-105b-405b-8bf7-bbdd78a1b99b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf640f3e-3d77-46ee-8a11-e0bdc870ff97", "name": "network-vif-plugged", "status": "completed", "tag": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-94a99047-556d-451e-8aac-cd86efeab7c7 req-bc32cd10-105b-405b-8bf7-bbdd78a1b99b service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-94a99047-556d-451e-8aac-cd86efeab7c7 req-bc32cd10-105b-405b-8bf7-bbdd78a1b99b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-94a99047-556d-451e-8aac-cd86efeab7c7 req-bc32cd10-105b-405b-8bf7-bbdd78a1b99b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:16 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:52:16 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-94a99047-556d-451e-8aac-cd86efeab7c7 req-bc32cd10-105b-405b-8bf7-bbdd78a1b99b service nova] Creating event network-vif-plugged:ee0e2f74-c744-41ec-b3f8-c7d124c61f8e for instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 on user Apr 14 18:52:16 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-94a99047-556d-451e-8aac-cd86efeab7c7 req-bc32cd10-105b-405b-8bf7-bbdd78a1b99b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066830 Apr 14 18:52:16 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 131/392] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:52:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:17 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:52:17 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:17 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:17 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:17 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:17 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:17 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:17 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:17 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Going to try to terminate instance {{(pid=61674) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 18:52:17 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae" status: 204 len: 0 microversion: 2.1 time: 0.141818 Apr 14 18:52:17 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 133/393] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 18:52:17 2023] DELETE /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 18:52:17 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-65ef5120-cb1b-478d-a0a4-30d84d36f15c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:52:17 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-65ef5120-cb1b-478d-a0a4-30d84d36f15c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:17 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-65ef5120-cb1b-478d-a0a4-30d84d36f15c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:17 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-65ef5120-cb1b-478d-a0a4-30d84d36f15c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:17 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-65ef5120-cb1b-478d-a0a4-30d84d36f15c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:17 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-65ef5120-cb1b-478d-a0a4-30d84d36f15c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:17 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-65ef5120-cb1b-478d-a0a4-30d84d36f15c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:17 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-65ef5120-cb1b-478d-a0a4-30d84d36f15c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:18 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-0040e419-ab7f-4817-a415-0269c4a8b499 req-621330ee-0139-4429-b2fb-e275fd8515e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "656b9f90-ce93-42cd-aa1b-3ff868162aae", "name": "network-vif-unplugged", "status": "completed", "tag": "324b6810-d265-48bc-a2a9-ff7d4759a910"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:18 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-0040e419-ab7f-4817-a415-0269c4a8b499 req-621330ee-0139-4429-b2fb-e275fd8515e4 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:18 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-0040e419-ab7f-4817-a415-0269c4a8b499 req-621330ee-0139-4429-b2fb-e275fd8515e4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:18 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-0040e419-ab7f-4817-a415-0269c4a8b499 req-621330ee-0139-4429-b2fb-e275fd8515e4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:18 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-65ef5120-cb1b-478d-a0a4-30d84d36f15c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e1d31c2d9048699758779dedf7d3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6b4e98cf9e4f96b79c3288dfe0da89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:52:18 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-0040e419-ab7f-4817-a415-0269c4a8b499 req-621330ee-0139-4429-b2fb-e275fd8515e4 service nova] Creating event network-vif-unplugged:324b6810-d265-48bc-a2a9-ff7d4759a910 for instance 656b9f90-ce93-42cd-aa1b-3ff868162aae on user Apr 14 18:52:18 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-65ef5120-cb1b-478d-a0a4-30d84d36f15c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae" status: 200 len: 1542 microversion: 2.1 time: 0.421670 Apr 14 18:52:18 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 130/394] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:52:17 2023] GET /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae => generated 1542 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:52:18 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-0040e419-ab7f-4817-a415-0269c4a8b499 req-621330ee-0139-4429-b2fb-e275fd8515e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081835 Apr 14 18:52:18 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 132/395] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:52:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:18 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-cab0ab17-6d46-450a-b2ab-e35bc7e3eac4 req-875d7444-f009-4b90-9a39-cc6d57a7c5a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf640f3e-3d77-46ee-8a11-e0bdc870ff97", "name": "network-vif-plugged", "status": "completed", "tag": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e"}, {"server_uuid": "cf640f3e-3d77-46ee-8a11-e0bdc870ff97", "name": "network-vif-plugged", "status": "completed", "tag": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:18 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-cab0ab17-6d46-450a-b2ab-e35bc7e3eac4 req-875d7444-f009-4b90-9a39-cc6d57a7c5a4 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:18 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-cab0ab17-6d46-450a-b2ab-e35bc7e3eac4 req-875d7444-f009-4b90-9a39-cc6d57a7c5a4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:18 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-cab0ab17-6d46-450a-b2ab-e35bc7e3eac4 req-875d7444-f009-4b90-9a39-cc6d57a7c5a4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:18 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-cab0ab17-6d46-450a-b2ab-e35bc7e3eac4 req-875d7444-f009-4b90-9a39-cc6d57a7c5a4 service nova] Creating event network-vif-plugged:ee0e2f74-c744-41ec-b3f8-c7d124c61f8e for instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 on user Apr 14 18:52:18 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-cab0ab17-6d46-450a-b2ab-e35bc7e3eac4 req-875d7444-f009-4b90-9a39-cc6d57a7c5a4 service nova] Creating event network-vif-plugged:ee0e2f74-c744-41ec-b3f8-c7d124c61f8e for instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 on user Apr 14 18:52:18 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-cab0ab17-6d46-450a-b2ab-e35bc7e3eac4 req-875d7444-f009-4b90-9a39-cc6d57a7c5a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052762 Apr 14 18:52:18 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 134/396] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:52:18 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:19 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-14dc8b03-dc3f-47d6-8f73-c04073b6f80d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:52:19 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-14dc8b03-dc3f-47d6-8f73-c04073b6f80d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-14dc8b03-dc3f-47d6-8f73-c04073b6f80d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-14dc8b03-dc3f-47d6-8f73-c04073b6f80d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-14dc8b03-dc3f-47d6-8f73-c04073b6f80d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-14dc8b03-dc3f-47d6-8f73-c04073b6f80d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-14dc8b03-dc3f-47d6-8f73-c04073b6f80d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-14dc8b03-dc3f-47d6-8f73-c04073b6f80d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:19 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-14dc8b03-dc3f-47d6-8f73-c04073b6f80d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] HTTP exception thrown: Instance 482b8c77-c963-4bc1-8e3c-847650736767 could not be found. Apr 14 18:52:19 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-14dc8b03-dc3f-47d6-8f73-c04073b6f80d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Request method failure captured: Apr 14 18:52:19 user devstack@n-api.service[61673]: request: GET /compute/v2.1/servers/482b8c77-c963-4bc1-8e3c-847650736767 HTTP/1.1 Apr 14 18:52:19 user devstack@n-api.service[61673]: Accept: application/json Apr 14 18:52:19 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 18:52:19 user devstack@n-api.service[61673]: Connection: close Apr 14 18:52:19 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 18:52:19 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 18:52:19 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 18:52:19 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 18:52:19 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 18:52:19 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOZ91Dy52y80HoUx_25txBgAmdKy_dzVjWjY1ksSEjioYtZS_I_NYqQvpViXWkKPnxgf56UahBdEppDz8gnLZadIBfA0bvGJo_tJO0X624LWTeHmN5ztGzSPLT3ogEGrsduTHdRctRKOcdHh9YBu4Kq1db7JzZe-LLVD5zRuDGi5LnSs Apr 14 18:52:19 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 18:52:19 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 18:52:19 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 18:52:19 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 18:52:19 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 18:52:19 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 18:52:19 user devstack@n-api.service[61673]: X-Project-Id: d22a362d9cb946a99c203366f88baafb Apr 14 18:52:19 user devstack@n-api.service[61673]: X-Project-Name: tempest-VolumesAdminNegativeTest-714849235 Apr 14 18:52:19 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 18:52:19 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 18:52:19 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d22a362d9cb946a99c203366f88baafb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d22a362d9cb946a99c203366f88baafb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d22a362d9cb946a99c203366f88baafb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:52:19 user devstack@n-api.service[61673]: X-Tenant: tempest-VolumesAdminNegativeTest-714849235 Apr 14 18:52:19 user devstack@n-api.service[61673]: X-Tenant-Id: d22a362d9cb946a99c203366f88baafb Apr 14 18:52:19 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-714849235 Apr 14 18:52:19 user devstack@n-api.service[61673]: X-User: tempest-VolumesAdminNegativeTest-714849235-project-member Apr 14 18:52:19 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 18:52:19 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 18:52:19 user devstack@n-api.service[61673]: X-User-Id: 3f78850ecd8042dbac5f24113b9df70e Apr 14 18:52:19 user devstack@n-api.service[61673]: X-User-Name: tempest-VolumesAdminNegativeTest-714849235-project-member Apr 14 18:52:19 user devstack@n-api.service[61673]: method: > Apr 14 18:52:19 user devstack@n-api.service[61673]: exception: Instance 482b8c77-c963-4bc1-8e3c-847650736767 could not be found. Apr 14 18:52:19 user devstack@n-api.service[61673]: action_args: {'id': '482b8c77-c963-4bc1-8e3c-847650736767'} Apr 14 18:52:19 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 482b8c77-c963-4bc1-8e3c-847650736767 could not be found. Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 482b8c77-c963-4bc1-8e3c-847650736767 could not be found. Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 482b8c77-c963-4bc1-8e3c-847650736767 could not be found. Apr 14 18:52:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:52:19 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-14dc8b03-dc3f-47d6-8f73-c04073b6f80d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Returning 404 to user: Instance 482b8c77-c963-4bc1-8e3c-847650736767 could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:52:19 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-14dc8b03-dc3f-47d6-8f73-c04073b6f80d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/482b8c77-c963-4bc1-8e3c-847650736767" status: 404 len: 111 microversion: 2.1 time: 0.033278 Apr 14 18:52:19 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 131/397] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:52:19 2023] GET /compute/v2.1/servers/482b8c77-c963-4bc1-8e3c-847650736767 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:52:20 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-c367b92d-f342-4170-9d4d-24d494878b78 req-1e4cdd86-2f75-4eba-b0a1-aa765323b309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "656b9f90-ce93-42cd-aa1b-3ff868162aae", "name": "network-vif-plugged", "status": "completed", "tag": "324b6810-d265-48bc-a2a9-ff7d4759a910"}, {"server_uuid": "656b9f90-ce93-42cd-aa1b-3ff868162aae", "name": "network-vif-deleted", "tag": "324b6810-d265-48bc-a2a9-ff7d4759a910"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:20 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-c367b92d-f342-4170-9d4d-24d494878b78 req-1e4cdd86-2f75-4eba-b0a1-aa765323b309 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:20 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-c367b92d-f342-4170-9d4d-24d494878b78 req-1e4cdd86-2f75-4eba-b0a1-aa765323b309 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:20 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-c367b92d-f342-4170-9d4d-24d494878b78 req-1e4cdd86-2f75-4eba-b0a1-aa765323b309 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:20 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-c367b92d-f342-4170-9d4d-24d494878b78 req-1e4cdd86-2f75-4eba-b0a1-aa765323b309 service nova] Creating event network-vif-plugged:324b6810-d265-48bc-a2a9-ff7d4759a910 for instance 656b9f90-ce93-42cd-aa1b-3ff868162aae on user Apr 14 18:52:20 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-c367b92d-f342-4170-9d4d-24d494878b78 req-1e4cdd86-2f75-4eba-b0a1-aa765323b309 service nova] Creating event network-vif-deleted:324b6810-d265-48bc-a2a9-ff7d4759a910 for instance 656b9f90-ce93-42cd-aa1b-3ff868162aae on user Apr 14 18:52:20 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-c367b92d-f342-4170-9d4d-24d494878b78 req-1e4cdd86-2f75-4eba-b0a1-aa765323b309 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030351 Apr 14 18:52:20 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 133/398] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:52:20 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:22 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-344a94e5-b7dd-4e81-9f82-a8aa1b260042 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:52:22 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-344a94e5-b7dd-4e81-9f82-a8aa1b260042 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:22 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-344a94e5-b7dd-4e81-9f82-a8aa1b260042 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:22 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-344a94e5-b7dd-4e81-9f82-a8aa1b260042 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:22 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-344a94e5-b7dd-4e81-9f82-a8aa1b260042 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:22 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-344a94e5-b7dd-4e81-9f82-a8aa1b260042 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:22 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-344a94e5-b7dd-4e81-9f82-a8aa1b260042 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:22 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-344a94e5-b7dd-4e81-9f82-a8aa1b260042 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:22 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-344a94e5-b7dd-4e81-9f82-a8aa1b260042 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f90c8f23e3b42a98fdb9261db65f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf25bcc0dea4d3eb1284e8995eb3466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:52:22 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-344a94e5-b7dd-4e81-9f82-a8aa1b260042 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4" status: 200 len: 1537 microversion: 2.1 time: 0.313513 Apr 14 18:52:22 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 135/399] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:52:21 2023] GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4 => generated 1537 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:52:23 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:52:23 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:23 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Going to try to terminate instance {{(pid=61673) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 18:52:24 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/817f112c-d806-4800-9e4a-a3892c54bee1" status: 204 len: 0 microversion: 2.1 time: 0.142601 Apr 14 18:52:24 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 132/400] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 18:52:23 2023] DELETE /compute/v2.1/servers/817f112c-d806-4800-9e4a-a3892c54bee1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 18:52:24 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-c3cee443-8022-484c-b42d-2d1a9a912d75 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:52:24 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-c3cee443-8022-484c-b42d-2d1a9a912d75 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c3cee443-8022-484c-b42d-2d1a9a912d75 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c3cee443-8022-484c-b42d-2d1a9a912d75 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c3cee443-8022-484c-b42d-2d1a9a912d75 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c3cee443-8022-484c-b42d-2d1a9a912d75 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c3cee443-8022-484c-b42d-2d1a9a912d75 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c3cee443-8022-484c-b42d-2d1a9a912d75 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:24 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-5a1995b3-c0e6-4b4c-be93-329d788d798c req-3eedef36-ff29-4e92-b98d-708b2db19b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "817f112c-d806-4800-9e4a-a3892c54bee1", "name": "network-vif-unplugged", "status": "completed", "tag": "4a744ab3-b516-4349-adfd-98d2ce4332d2"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:24 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-c3cee443-8022-484c-b42d-2d1a9a912d75 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f78850ecd8042dbac5f24113b9df70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22a362d9cb946a99c203366f88baafb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:52:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-5a1995b3-c0e6-4b4c-be93-329d788d798c req-3eedef36-ff29-4e92-b98d-708b2db19b0d service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-5a1995b3-c0e6-4b4c-be93-329d788d798c req-3eedef36-ff29-4e92-b98d-708b2db19b0d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-5a1995b3-c0e6-4b4c-be93-329d788d798c req-3eedef36-ff29-4e92-b98d-708b2db19b0d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:24 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-c3cee443-8022-484c-b42d-2d1a9a912d75 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/817f112c-d806-4800-9e4a-a3892c54bee1" status: 200 len: 1668 microversion: 2.1 time: 0.329842 Apr 14 18:52:24 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 134/401] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:52:24 2023] GET /compute/v2.1/servers/817f112c-d806-4800-9e4a-a3892c54bee1 => generated 1668 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:52:24 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-5a1995b3-c0e6-4b4c-be93-329d788d798c req-3eedef36-ff29-4e92-b98d-708b2db19b0d service nova] Creating event network-vif-unplugged:4a744ab3-b516-4349-adfd-98d2ce4332d2 for instance 817f112c-d806-4800-9e4a-a3892c54bee1 on user Apr 14 18:52:24 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-5a1995b3-c0e6-4b4c-be93-329d788d798c req-3eedef36-ff29-4e92-b98d-708b2db19b0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052687 Apr 14 18:52:24 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 136/402] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:52:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:25 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-89ae51b4-eb07-486c-b682-93035060e5d0 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:52:25 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-89ae51b4-eb07-486c-b682-93035060e5d0 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-89ae51b4-eb07-486c-b682-93035060e5d0 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-89ae51b4-eb07-486c-b682-93035060e5d0 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-89ae51b4-eb07-486c-b682-93035060e5d0 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-89ae51b4-eb07-486c-b682-93035060e5d0 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-89ae51b4-eb07-486c-b682-93035060e5d0 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-89ae51b4-eb07-486c-b682-93035060e5d0 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:26 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-89ae51b4-eb07-486c-b682-93035060e5d0 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc260db7-ffd6-4b7a-8b70-b4070478faab/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.618296 Apr 14 18:52:26 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 133/403] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 18:52:25 2023] GET /compute/v2.1/servers/dc260db7-ffd6-4b7a-8b70-b4070478faab/os-interface => generated 1828 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:52:26 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-d712ea4d-0e3e-4d08-a4e4-fe17fb1a452e req-3265e26d-e87a-49f8-941f-ecc99ba4e0be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "817f112c-d806-4800-9e4a-a3892c54bee1", "name": "network-vif-plugged", "status": "completed", "tag": "4a744ab3-b516-4349-adfd-98d2ce4332d2"}, {"server_uuid": "817f112c-d806-4800-9e4a-a3892c54bee1", "name": "network-vif-deleted", "tag": "4a744ab3-b516-4349-adfd-98d2ce4332d2"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:26 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-d712ea4d-0e3e-4d08-a4e4-fe17fb1a452e req-3265e26d-e87a-49f8-941f-ecc99ba4e0be service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:26 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-d712ea4d-0e3e-4d08-a4e4-fe17fb1a452e req-3265e26d-e87a-49f8-941f-ecc99ba4e0be service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:26 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-d712ea4d-0e3e-4d08-a4e4-fe17fb1a452e req-3265e26d-e87a-49f8-941f-ecc99ba4e0be service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:26 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-d712ea4d-0e3e-4d08-a4e4-fe17fb1a452e req-3265e26d-e87a-49f8-941f-ecc99ba4e0be service nova] Creating event network-vif-plugged:4a744ab3-b516-4349-adfd-98d2ce4332d2 for instance 817f112c-d806-4800-9e4a-a3892c54bee1 on user Apr 14 18:52:26 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-d712ea4d-0e3e-4d08-a4e4-fe17fb1a452e req-3265e26d-e87a-49f8-941f-ecc99ba4e0be service nova] Creating event network-vif-deleted:4a744ab3-b516-4349-adfd-98d2ce4332d2 for instance 817f112c-d806-4800-9e4a-a3892c54bee1 on user Apr 14 18:52:26 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-d712ea4d-0e3e-4d08-a4e4-fe17fb1a452e req-3265e26d-e87a-49f8-941f-ecc99ba4e0be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032655 Apr 14 18:52:26 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 135/404] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:52:26 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:27 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-01439c88-789d-42d0-b453-b40e5ccfa214 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:52:27 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-01439c88-789d-42d0-b453-b40e5ccfa214 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:27 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-01439c88-789d-42d0-b453-b40e5ccfa214 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:27 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-01439c88-789d-42d0-b453-b40e5ccfa214 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:27 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-01439c88-789d-42d0-b453-b40e5ccfa214 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:27 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-01439c88-789d-42d0-b453-b40e5ccfa214 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:27 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-01439c88-789d-42d0-b453-b40e5ccfa214 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:27 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-01439c88-789d-42d0-b453-b40e5ccfa214 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:28 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-01439c88-789d-42d0-b453-b40e5ccfa214 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee19795311144e69dd00db0403cb8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c49bffa4d8e4f92a54ad17a5f5db634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:52:28 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-01439c88-789d-42d0-b453-b40e5ccfa214 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ee19795311144e69dd00db0403cb8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c49bffa4d8e4f92a54ad17a5f5db634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:52:28 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-01439c88-789d-42d0-b453-b40e5ccfa214 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ee19795311144e69dd00db0403cb8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c49bffa4d8e4f92a54ad17a5f5db634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:52:28 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-01439c88-789d-42d0-b453-b40e5ccfa214 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc260db7-ffd6-4b7a-8b70-b4070478faab" status: 200 len: 2828 microversion: 2.42 time: 0.503058 Apr 14 18:52:28 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 137/405] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:52:27 2023] GET /compute/v2.1/servers/dc260db7-ffd6-4b7a-8b70-b4070478faab => generated 2828 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 18:52:28 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-4a6557b6-6774-4ebf-b470-68c3eecea5e3 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:52:28 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-4a6557b6-6774-4ebf-b470-68c3eecea5e3 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4a6557b6-6774-4ebf-b470-68c3eecea5e3 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4a6557b6-6774-4ebf-b470-68c3eecea5e3 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4a6557b6-6774-4ebf-b470-68c3eecea5e3 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4a6557b6-6774-4ebf-b470-68c3eecea5e3 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4a6557b6-6774-4ebf-b470-68c3eecea5e3 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4a6557b6-6774-4ebf-b470-68c3eecea5e3 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:28 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-4a6557b6-6774-4ebf-b470-68c3eecea5e3 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc260db7-ffd6-4b7a-8b70-b4070478faab/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.130126 Apr 14 18:52:28 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 134/406] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 18:52:28 2023] GET /compute/v2.1/servers/dc260db7-ffd6-4b7a-8b70-b4070478faab/os-interface => generated 1828 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:52:28 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-9ca45125-d1e5-46a2-abd3-34c9ebc69059 req-6e5a2e3e-e8d8-4edd-872f-89cea4481a44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "tag": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:28 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-9ca45125-d1e5-46a2-abd3-34c9ebc69059 req-6e5a2e3e-e8d8-4edd-872f-89cea4481a44 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:28 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-9ca45125-d1e5-46a2-abd3-34c9ebc69059 req-6e5a2e3e-e8d8-4edd-872f-89cea4481a44 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:28 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-9ca45125-d1e5-46a2-abd3-34c9ebc69059 req-6e5a2e3e-e8d8-4edd-872f-89cea4481a44 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:28 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-9ca45125-d1e5-46a2-abd3-34c9ebc69059 req-6e5a2e3e-e8d8-4edd-872f-89cea4481a44 service nova] Creating event network-changed:7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8 for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:52:28 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-9ca45125-d1e5-46a2-abd3-34c9ebc69059 req-6e5a2e3e-e8d8-4edd-872f-89cea4481a44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033854 Apr 14 18:52:28 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 136/407] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:52:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:29 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:52:29 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:29 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Going to try to terminate instance {{(pid=61674) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 18:52:29 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dc260db7-ffd6-4b7a-8b70-b4070478faab" status: 204 len: 0 microversion: 2.42 time: 0.134807 Apr 14 18:52:29 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 138/408] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 18:52:29 2023] DELETE /compute/v2.1/servers/dc260db7-ffd6-4b7a-8b70-b4070478faab => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 18:52:29 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-5d8d20eb-92d9-49c0-ac2d-6ad8b89a4e92 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:52:29 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-5d8d20eb-92d9-49c0-ac2d-6ad8b89a4e92 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5d8d20eb-92d9-49c0-ac2d-6ad8b89a4e92 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5d8d20eb-92d9-49c0-ac2d-6ad8b89a4e92 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5d8d20eb-92d9-49c0-ac2d-6ad8b89a4e92 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5d8d20eb-92d9-49c0-ac2d-6ad8b89a4e92 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5d8d20eb-92d9-49c0-ac2d-6ad8b89a4e92 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5d8d20eb-92d9-49c0-ac2d-6ad8b89a4e92 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:30 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-d121ad84-53bb-40f9-aaa3-3bf69b3d010e req-0d0f94f2-e683-485f-909f-b95755718779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-unplugged", "status": "completed", "tag": "f4fbff28-9aec-444f-aef4-a67e882a9255"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-d121ad84-53bb-40f9-aaa3-3bf69b3d010e req-0d0f94f2-e683-485f-909f-b95755718779 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-d121ad84-53bb-40f9-aaa3-3bf69b3d010e req-0d0f94f2-e683-485f-909f-b95755718779 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-d121ad84-53bb-40f9-aaa3-3bf69b3d010e req-0d0f94f2-e683-485f-909f-b95755718779 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:30 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-d121ad84-53bb-40f9-aaa3-3bf69b3d010e req-0d0f94f2-e683-485f-909f-b95755718779 service nova] Creating event network-vif-unplugged:f4fbff28-9aec-444f-aef4-a67e882a9255 for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:52:30 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-d121ad84-53bb-40f9-aaa3-3bf69b3d010e req-0d0f94f2-e683-485f-909f-b95755718779 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055453 Apr 14 18:52:30 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 137/409] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:52:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:30 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-5d8d20eb-92d9-49c0-ac2d-6ad8b89a4e92 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee19795311144e69dd00db0403cb8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c49bffa4d8e4f92a54ad17a5f5db634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:52:30 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-5d8d20eb-92d9-49c0-ac2d-6ad8b89a4e92 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ee19795311144e69dd00db0403cb8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c49bffa4d8e4f92a54ad17a5f5db634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:52:30 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-5d8d20eb-92d9-49c0-ac2d-6ad8b89a4e92 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ee19795311144e69dd00db0403cb8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c49bffa4d8e4f92a54ad17a5f5db634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:52:30 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-5d8d20eb-92d9-49c0-ac2d-6ad8b89a4e92 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc260db7-ffd6-4b7a-8b70-b4070478faab" status: 200 len: 2953 microversion: 2.42 time: 0.900829 Apr 14 18:52:30 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 135/410] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:52:29 2023] GET /compute/v2.1/servers/dc260db7-ffd6-4b7a-8b70-b4070478faab => generated 2953 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:52:30 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-9c8dcd6d-8be3-4270-8d5d-1a6e1abdae16 req-05f2dbdf-ddee-4a46-b3c5-4e089b12924b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-unplugged", "status": "completed", "tag": "6dc22897-5349-4914-8ab8-eafee74a17dc"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:30 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-9c8dcd6d-8be3-4270-8d5d-1a6e1abdae16 req-05f2dbdf-ddee-4a46-b3c5-4e089b12924b service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:30 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-9c8dcd6d-8be3-4270-8d5d-1a6e1abdae16 req-05f2dbdf-ddee-4a46-b3c5-4e089b12924b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:30 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-9c8dcd6d-8be3-4270-8d5d-1a6e1abdae16 req-05f2dbdf-ddee-4a46-b3c5-4e089b12924b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:30 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-9c8dcd6d-8be3-4270-8d5d-1a6e1abdae16 req-05f2dbdf-ddee-4a46-b3c5-4e089b12924b service nova] Creating event network-vif-unplugged:6dc22897-5349-4914-8ab8-eafee74a17dc for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:52:30 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-9c8dcd6d-8be3-4270-8d5d-1a6e1abdae16 req-05f2dbdf-ddee-4a46-b3c5-4e089b12924b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032660 Apr 14 18:52:30 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 139/411] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:52:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:30 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-960df98e-4254-47fc-808d-67b3849e3fbf req-9b6950b2-95d1-4463-8ace-b87e75a0b965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-unplugged", "status": "completed", "tag": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8"}, {"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-plugged", "status": "completed", "tag": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8"}, {"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-unplugged", "status": "completed", "tag": "2af029d9-055b-406b-a82d-a88d8b51c4fa"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-960df98e-4254-47fc-808d-67b3849e3fbf req-9b6950b2-95d1-4463-8ace-b87e75a0b965 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-960df98e-4254-47fc-808d-67b3849e3fbf req-9b6950b2-95d1-4463-8ace-b87e75a0b965 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-960df98e-4254-47fc-808d-67b3849e3fbf req-9b6950b2-95d1-4463-8ace-b87e75a0b965 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:30 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-960df98e-4254-47fc-808d-67b3849e3fbf req-9b6950b2-95d1-4463-8ace-b87e75a0b965 service nova] Creating event network-vif-unplugged:7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8 for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:52:30 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-960df98e-4254-47fc-808d-67b3849e3fbf req-9b6950b2-95d1-4463-8ace-b87e75a0b965 service nova] Creating event network-vif-plugged:7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8 for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:52:30 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-960df98e-4254-47fc-808d-67b3849e3fbf req-9b6950b2-95d1-4463-8ace-b87e75a0b965 service nova] Creating event network-vif-unplugged:2af029d9-055b-406b-a82d-a88d8b51c4fa for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:52:30 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-960df98e-4254-47fc-808d-67b3849e3fbf req-9b6950b2-95d1-4463-8ace-b87e75a0b965 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.040787 Apr 14 18:52:30 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 138/412] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:52:30 2023] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:32 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-plugged", "status": "completed", "tag": "f4fbff28-9aec-444f-aef4-a67e882a9255"}, {"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-unplugged", "status": "completed", "tag": "6b1efba7-12bf-4333-a320-c76218ba1b09"}, {"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-plugged", "status": "completed", "tag": "6b1efba7-12bf-4333-a320-c76218ba1b09"}, {"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-unplugged", "status": "completed", "tag": "3ad5bb9e-1641-4726-887d-031aeadf4c60"}, {"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-plugged", "status": "completed", "tag": "3ad5bb9e-1641-4726-887d-031aeadf4c60"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:32 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] Creating event network-vif-plugged:f4fbff28-9aec-444f-aef4-a67e882a9255 for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:52:32 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] Creating event network-vif-unplugged:6b1efba7-12bf-4333-a320-c76218ba1b09 for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:52:32 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] Creating event network-vif-plugged:6b1efba7-12bf-4333-a320-c76218ba1b09 for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:52:32 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] Creating event network-vif-unplugged:3ad5bb9e-1641-4726-887d-031aeadf4c60 for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:52:32 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] Creating event network-vif-plugged:3ad5bb9e-1641-4726-887d-031aeadf4c60 for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:52:32 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.041146 Apr 14 18:52:32 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 136/413] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:52:32 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:32 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-7182fb81-22da-4318-a4f8-0676743597f3 req-cbb75a1a-3fcd-4f38-818b-5fab1cd5ffbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-plugged", "status": "completed", "tag": "6dc22897-5349-4914-8ab8-eafee74a17dc"}, {"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-unplugged", "status": "completed", "tag": "bb067fd8-e349-48fe-8450-b2308b4ccdab"}, {"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-plugged", "status": "completed", "tag": "bb067fd8-e349-48fe-8450-b2308b4ccdab"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:32 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-7182fb81-22da-4318-a4f8-0676743597f3 req-cbb75a1a-3fcd-4f38-818b-5fab1cd5ffbd service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:32 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-7182fb81-22da-4318-a4f8-0676743597f3 req-cbb75a1a-3fcd-4f38-818b-5fab1cd5ffbd service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:32 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-7182fb81-22da-4318-a4f8-0676743597f3 req-cbb75a1a-3fcd-4f38-818b-5fab1cd5ffbd service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:32 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-7182fb81-22da-4318-a4f8-0676743597f3 req-cbb75a1a-3fcd-4f38-818b-5fab1cd5ffbd service nova] Creating event network-vif-plugged:6dc22897-5349-4914-8ab8-eafee74a17dc for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:52:32 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-7182fb81-22da-4318-a4f8-0676743597f3 req-cbb75a1a-3fcd-4f38-818b-5fab1cd5ffbd service nova] Creating event network-vif-unplugged:bb067fd8-e349-48fe-8450-b2308b4ccdab for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:52:32 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-7182fb81-22da-4318-a4f8-0676743597f3 req-cbb75a1a-3fcd-4f38-818b-5fab1cd5ffbd service nova] Creating event network-vif-plugged:bb067fd8-e349-48fe-8450-b2308b4ccdab for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:52:32 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-7182fb81-22da-4318-a4f8-0676743597f3 req-cbb75a1a-3fcd-4f38-818b-5fab1cd5ffbd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.041664 Apr 14 18:52:32 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 140/414] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:52:32 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:32 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-327e7933-ab2c-4b68-9b10-661f5aa51a76 req-b6610bc7-5ef0-4074-a1f3-13c9330ae3c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-plugged", "status": "completed", "tag": "2af029d9-055b-406b-a82d-a88d8b51c4fa"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-327e7933-ab2c-4b68-9b10-661f5aa51a76 req-b6610bc7-5ef0-4074-a1f3-13c9330ae3c0 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-327e7933-ab2c-4b68-9b10-661f5aa51a76 req-b6610bc7-5ef0-4074-a1f3-13c9330ae3c0 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-327e7933-ab2c-4b68-9b10-661f5aa51a76 req-b6610bc7-5ef0-4074-a1f3-13c9330ae3c0 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:32 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-327e7933-ab2c-4b68-9b10-661f5aa51a76 req-b6610bc7-5ef0-4074-a1f3-13c9330ae3c0 service nova] Creating event network-vif-plugged:2af029d9-055b-406b-a82d-a88d8b51c4fa for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:52:32 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-327e7933-ab2c-4b68-9b10-661f5aa51a76 req-b6610bc7-5ef0-4074-a1f3-13c9330ae3c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037397 Apr 14 18:52:32 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 139/415] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:52:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:34 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:52:34 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:34 user devstack@n-api.service[61673]: DEBUG nova.objects.instance [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lazy-loading 'services' on Instance uuid 8e55c721-9fad-4478-9e74-e87d0c95bc3c {{(pid=61673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 18:52:34 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c/os-volume_attachments/e73ec3ca-6e83-4144-8fe7-315e5ee57a71" status: 202 len: 0 microversion: 2.1 time: 0.246791 Apr 14 18:52:34 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 137/416] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 18:52:34 2023] DELETE /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c/os-volume_attachments/e73ec3ca-6e83-4144-8fe7-315e5ee57a71 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:52:34 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-83d4c400-4c8d-4326-8efc-68bf102e6725 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:52:34 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-83d4c400-4c8d-4326-8efc-68bf102e6725 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-83d4c400-4c8d-4326-8efc-68bf102e6725 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-83d4c400-4c8d-4326-8efc-68bf102e6725 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-83d4c400-4c8d-4326-8efc-68bf102e6725 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-83d4c400-4c8d-4326-8efc-68bf102e6725 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-83d4c400-4c8d-4326-8efc-68bf102e6725 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-83d4c400-4c8d-4326-8efc-68bf102e6725 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:34 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-83d4c400-4c8d-4326-8efc-68bf102e6725 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052779 Apr 14 18:52:34 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 141/417] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:52:34 2023] GET /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:34 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-d5cf9f32-0178-4f13-a8f8-cd30bb2e42fa req-24529be7-74d2-466e-82f2-4bdc746324d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-deleted", "tag": "6b1efba7-12bf-4333-a320-c76218ba1b09"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-d5cf9f32-0178-4f13-a8f8-cd30bb2e42fa req-24529be7-74d2-466e-82f2-4bdc746324d6 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-d5cf9f32-0178-4f13-a8f8-cd30bb2e42fa req-24529be7-74d2-466e-82f2-4bdc746324d6 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-d5cf9f32-0178-4f13-a8f8-cd30bb2e42fa req-24529be7-74d2-466e-82f2-4bdc746324d6 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:34 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-d5cf9f32-0178-4f13-a8f8-cd30bb2e42fa req-24529be7-74d2-466e-82f2-4bdc746324d6 service nova] Creating event network-vif-deleted:6b1efba7-12bf-4333-a320-c76218ba1b09 for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:52:34 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-d5cf9f32-0178-4f13-a8f8-cd30bb2e42fa req-24529be7-74d2-466e-82f2-4bdc746324d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033371 Apr 14 18:52:34 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 140/418] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:52:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:36 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-acd0eead-e570-454e-8b38-b2d9cf440bbc req-450b343f-3bd8-4ea2-ba99-b96a2a23d445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-deleted", "tag": "3ad5bb9e-1641-4726-887d-031aeadf4c60"}, {"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-deleted", "tag": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8"}, {"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-deleted", "tag": "bb067fd8-e349-48fe-8450-b2308b4ccdab"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:36 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-acd0eead-e570-454e-8b38-b2d9cf440bbc req-450b343f-3bd8-4ea2-ba99-b96a2a23d445 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:36 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-acd0eead-e570-454e-8b38-b2d9cf440bbc req-450b343f-3bd8-4ea2-ba99-b96a2a23d445 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:36 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-acd0eead-e570-454e-8b38-b2d9cf440bbc req-450b343f-3bd8-4ea2-ba99-b96a2a23d445 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:36 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-acd0eead-e570-454e-8b38-b2d9cf440bbc req-450b343f-3bd8-4ea2-ba99-b96a2a23d445 service nova] Creating event network-vif-deleted:3ad5bb9e-1641-4726-887d-031aeadf4c60 for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:52:36 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-acd0eead-e570-454e-8b38-b2d9cf440bbc req-450b343f-3bd8-4ea2-ba99-b96a2a23d445 service nova] Creating event network-vif-deleted:7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8 for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:52:36 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-acd0eead-e570-454e-8b38-b2d9cf440bbc req-450b343f-3bd8-4ea2-ba99-b96a2a23d445 service nova] Creating event network-vif-deleted:bb067fd8-e349-48fe-8450-b2308b4ccdab for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:52:36 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-acd0eead-e570-454e-8b38-b2d9cf440bbc req-450b343f-3bd8-4ea2-ba99-b96a2a23d445 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.044573 Apr 14 18:52:36 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 138/419] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:52:36 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:37 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-ff59dc59-80ac-4a5d-94c7-4b5859d941c7 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:52:37 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-ff59dc59-80ac-4a5d-94c7-4b5859d941c7 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ff59dc59-80ac-4a5d-94c7-4b5859d941c7 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ff59dc59-80ac-4a5d-94c7-4b5859d941c7 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ff59dc59-80ac-4a5d-94c7-4b5859d941c7 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ff59dc59-80ac-4a5d-94c7-4b5859d941c7 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ff59dc59-80ac-4a5d-94c7-4b5859d941c7 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ff59dc59-80ac-4a5d-94c7-4b5859d941c7 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:37 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-ff59dc59-80ac-4a5d-94c7-4b5859d941c7 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e3f2dda9bc49f48c66beb978dbdaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0091007734312b8d33caf294d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:52:37 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-ff59dc59-80ac-4a5d-94c7-4b5859d941c7 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2a860bd-802f-4760-b77b-92b7ac4ad09b" status: 200 len: 1433 microversion: 2.1 time: 0.522327 Apr 14 18:52:37 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 142/420] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:52:37 2023] GET /compute/v2.1/servers/a2a860bd-802f-4760-b77b-92b7ac4ad09b => generated 1433 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:52:38 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-e56696ce-74df-4f08-8f85-89b608a9ac20 req-4af9e0f0-b098-4661-bfd1-402f8537b4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc260db7-ffd6-4b7a-8b70-b4070478faab", "name": "network-vif-deleted", "tag": "6dc22897-5349-4914-8ab8-eafee74a17dc"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-e56696ce-74df-4f08-8f85-89b608a9ac20 req-4af9e0f0-b098-4661-bfd1-402f8537b4f5 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-e56696ce-74df-4f08-8f85-89b608a9ac20 req-4af9e0f0-b098-4661-bfd1-402f8537b4f5 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-e56696ce-74df-4f08-8f85-89b608a9ac20 req-4af9e0f0-b098-4661-bfd1-402f8537b4f5 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:38 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-e56696ce-74df-4f08-8f85-89b608a9ac20 req-4af9e0f0-b098-4661-bfd1-402f8537b4f5 service nova] Creating event network-vif-deleted:6dc22897-5349-4914-8ab8-eafee74a17dc for instance dc260db7-ffd6-4b7a-8b70-b4070478faab on user Apr 14 18:52:39 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-e56696ce-74df-4f08-8f85-89b608a9ac20 req-4af9e0f0-b098-4661-bfd1-402f8537b4f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031245 Apr 14 18:52:39 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 141/421] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:52:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:41 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-99f2b043-e9bd-4bdd-bc83-83bf7481e8c6 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:52:41 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-99f2b043-e9bd-4bdd-bc83-83bf7481e8c6 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-99f2b043-e9bd-4bdd-bc83-83bf7481e8c6 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-99f2b043-e9bd-4bdd-bc83-83bf7481e8c6 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-99f2b043-e9bd-4bdd-bc83-83bf7481e8c6 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-99f2b043-e9bd-4bdd-bc83-83bf7481e8c6 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-99f2b043-e9bd-4bdd-bc83-83bf7481e8c6 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-99f2b043-e9bd-4bdd-bc83-83bf7481e8c6 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:41 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-99f2b043-e9bd-4bdd-bc83-83bf7481e8c6 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] HTTP exception thrown: Instance 094a4a33-569e-4137-8798-743499f1046c could not be found. Apr 14 18:52:41 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-99f2b043-e9bd-4bdd-bc83-83bf7481e8c6 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Request method failure captured: Apr 14 18:52:41 user devstack@n-api.service[61673]: request: GET /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c HTTP/1.1 Apr 14 18:52:41 user devstack@n-api.service[61673]: Accept: application/json Apr 14 18:52:41 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 18:52:41 user devstack@n-api.service[61673]: Connection: close Apr 14 18:52:41 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 18:52:41 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 18:52:41 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 18:52:41 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 18:52:41 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 18:52:41 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOZ9mXKmSeVaIS46ajndcD0QEVOAAeNy4LVRU6htix22YmE3w_WsO57Wi55e6NRGyVz084DhOrXI8Tp0cfqtkOuptABoiofobC3zYryQ5y6CuXjmj_BNK8q3Ywj-icF3eYh62IR4e0eJMk7NufTqqWbSFQxNccWUoyS1F1P0cbefqlTY Apr 14 18:52:41 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 18:52:41 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 18:52:41 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 18:52:41 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 18:52:41 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 18:52:41 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 18:52:41 user devstack@n-api.service[61673]: X-Project-Id: e34cdebcd7154988a957deae140e8eab Apr 14 18:52:41 user devstack@n-api.service[61673]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 18:52:41 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 18:52:41 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 18:52:41 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:52:41 user devstack@n-api.service[61673]: X-Tenant: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 18:52:41 user devstack@n-api.service[61673]: X-Tenant-Id: e34cdebcd7154988a957deae140e8eab Apr 14 18:52:41 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 18:52:41 user devstack@n-api.service[61673]: X-User: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 18:52:41 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 18:52:41 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 18:52:41 user devstack@n-api.service[61673]: X-User-Id: 8d53edaffb8f4038abd366d7942c6bc7 Apr 14 18:52:41 user devstack@n-api.service[61673]: X-User-Name: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 18:52:41 user devstack@n-api.service[61673]: method: > Apr 14 18:52:41 user devstack@n-api.service[61673]: exception: Instance 094a4a33-569e-4137-8798-743499f1046c could not be found. Apr 14 18:52:41 user devstack@n-api.service[61673]: action_args: {'id': '094a4a33-569e-4137-8798-743499f1046c'} Apr 14 18:52:41 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 094a4a33-569e-4137-8798-743499f1046c could not be found. Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 094a4a33-569e-4137-8798-743499f1046c could not be found. Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 094a4a33-569e-4137-8798-743499f1046c could not be found. Apr 14 18:52:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:52:41 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-99f2b043-e9bd-4bdd-bc83-83bf7481e8c6 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Returning 404 to user: Instance 094a4a33-569e-4137-8798-743499f1046c could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:52:41 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-99f2b043-e9bd-4bdd-bc83-83bf7481e8c6 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c" status: 404 len: 111 microversion: 2.1 time: 0.031771 Apr 14 18:52:41 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 139/422] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:52:41 2023] GET /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:52:41 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-40f6e969-05a6-4128-9d88-8f62c114ba29 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '.version_select at 0x7fdae1174dc0>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:52:41 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-40f6e969-05a6-4128-9d88-8f62c114ba29 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-275380641" status: 202 len: 0 microversion: 2.1 time: 0.091633 Apr 14 18:52:41 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 143/423] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 18:52:41 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-275380641 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:52:42 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-bfff86ee-f79a-4a45-a057-693480d09fcf tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Action: 'create', calling method: .version_select at 0x7fdae11efbe0>, body: {"keypair": {"name": "tempest-keypair-1273846851", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBdTHH0H6VXNnMYimnSG4KckCVTwmifHZuurimvpTfWYb4mgJKyCtQIabvc1PZ8V26HhS8h70WozUX1N4eA51ipk4XibhZWDpmGlM6sre8QIwBcSpKz+aM7zxlomNBtFw=="}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:42 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-bfff86ee-f79a-4a45-a057-693480d09fcf tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Getting quotas for project e34cdebcd7154988a957deae140e8eab. Resources: {'key_pairs'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:52:42 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-bfff86ee-f79a-4a45-a057-693480d09fcf tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Getting quotas for user 8d53edaffb8f4038abd366d7942c6bc7 and project e34cdebcd7154988a957deae140e8eab. Resources: {'key_pairs'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:52:42 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-bfff86ee-f79a-4a45-a057-693480d09fcf tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046260 Apr 14 18:52:42 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 142/424] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 18:52:42 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:43 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-e6a9a5fe-03db-4b37-be0d-a9bcddfcbc80 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:43 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-e6a9a5fe-03db-4b37-be0d-a9bcddfcbc80 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:43 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:52:43 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e6a9a5fe-03db-4b37-be0d-a9bcddfcbc80 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:43 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e6a9a5fe-03db-4b37-be0d-a9bcddfcbc80 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:43 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e6a9a5fe-03db-4b37-be0d-a9bcddfcbc80 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:43 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e6a9a5fe-03db-4b37-be0d-a9bcddfcbc80 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:43 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e6a9a5fe-03db-4b37-be0d-a9bcddfcbc80 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:43 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e6a9a5fe-03db-4b37-be0d-a9bcddfcbc80 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:43 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:52:43 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-e6a9a5fe-03db-4b37-be0d-a9bcddfcbc80 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "POST /compute/v2.1/servers/23d14a51-41aa-4827-bd60-c605d9689bc8/action" status: 202 len: 0 microversion: 2.87 time: 0.220801 Apr 14 18:52:43 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 140/425] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 18:52:43 2023] POST /compute/v2.1/servers/23d14a51-41aa-4827-bd60-c605d9689bc8/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 18:52:43 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-acda79cb-ccb3-4dcd-8495-95ed38472b1c tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:52:43 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-acda79cb-ccb3-4dcd-8495-95ed38472b1c tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-acda79cb-ccb3-4dcd-8495-95ed38472b1c tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-acda79cb-ccb3-4dcd-8495-95ed38472b1c tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-acda79cb-ccb3-4dcd-8495-95ed38472b1c tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-acda79cb-ccb3-4dcd-8495-95ed38472b1c tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-acda79cb-ccb3-4dcd-8495-95ed38472b1c tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-acda79cb-ccb3-4dcd-8495-95ed38472b1c tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:43 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-acda79cb-ccb3-4dcd-8495-95ed38472b1c tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:52:43 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:52:43 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-acda79cb-ccb3-4dcd-8495-95ed38472b1c tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:52:43 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-acda79cb-ccb3-4dcd-8495-95ed38472b1c tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:52:43 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:52:43 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-acda79cb-ccb3-4dcd-8495-95ed38472b1c tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23d14a51-41aa-4827-bd60-c605d9689bc8" status: 200 len: 1762 microversion: 2.87 time: 0.332048 Apr 14 18:52:43 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 144/426] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:52:43 2023] GET /compute/v2.1/servers/23d14a51-41aa-4827-bd60-c605d9689bc8 => generated 1762 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:52:43 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-392017485", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ebff2aa0-97cc-48ab-8839-3dff795a5b06"}], "security_groups": [{"name": "tempest-securitygroup--372509019"}], "key_name": "tempest-keypair-1273846851", "user_data": "}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:43 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:52:44 user devstack@n-api.service[61675]: DEBUG nova.network.neutron [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] validate_networks() for [('ebff2aa0-97cc-48ab-8839-3dff795a5b06', None, None, None, None, None)] {{(pid=61675) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:52:44 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1966d299-f72f-45d4-91de-eff266b7e44d", "device": "/dev/vdb"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:44 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:44 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:44 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:44 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:44 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:44 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:44 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:44 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-1ec045b0-1a84-4fcc-9f2a-df274c1258c5 req-62f5a154-9409-4eaa-bef9-fa82b6612e1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d14a51-41aa-4827-bd60-c605d9689bc8", "name": "network-vif-unplugged", "status": "completed", "tag": "b8044678-899b-4461-bbf0-cf9fd662e71e"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:44 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-1ec045b0-1a84-4fcc-9f2a-df274c1258c5 req-62f5a154-9409-4eaa-bef9-fa82b6612e1a service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:44 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-1ec045b0-1a84-4fcc-9f2a-df274c1258c5 req-62f5a154-9409-4eaa-bef9-fa82b6612e1a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:44 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-1ec045b0-1a84-4fcc-9f2a-df274c1258c5 req-62f5a154-9409-4eaa-bef9-fa82b6612e1a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:44 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-1ec045b0-1a84-4fcc-9f2a-df274c1258c5 req-62f5a154-9409-4eaa-bef9-fa82b6612e1a service nova] Creating event network-vif-unplugged:b8044678-899b-4461-bbf0-cf9fd662e71e for instance 23d14a51-41aa-4827-bd60-c605d9689bc8 on user Apr 14 18:52:44 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-1ec045b0-1a84-4fcc-9f2a-df274c1258c5 req-62f5a154-9409-4eaa-bef9-fa82b6612e1a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038882 Apr 14 18:52:44 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 145/427] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:52:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:44 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1285eca2-575b-4550-a424-605fb186b510/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.443392 Apr 14 18:52:44 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 141/428] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 18:52:43 2023] POST /compute/v2.1/servers/1285eca2-575b-4550-a424-605fb186b510/os-volume_attachments => generated 194 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:44 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Flavor limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:52:44 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Image limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:52:44 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Flavor pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:52:44 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Image pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:52:44 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:52:44 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:44 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:44 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:44 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:44 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:44 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:44 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Getting quotas for project e34cdebcd7154988a957deae140e8eab. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:52:44 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Getting quotas for user 8d53edaffb8f4038abd366d7942c6bc7 and project e34cdebcd7154988a957deae140e8eab. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:52:44 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Going to run 1 instances... {{(pid=61675) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:52:44 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:52:44 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.788624 Apr 14 18:52:44 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 143/429] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:52:43 2023] POST /compute/v2.1/servers => generated 399 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:52:44 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-2322110e-233a-42e0-b98b-4b527e724718 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:52:44 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-2322110e-233a-42e0-b98b-4b527e724718 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:52:44 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-2322110e-233a-42e0-b98b-4b527e724718 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d53edaffb8f4038abd366d7942c6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34cdebcd7154988a957deae140e8eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:52:44 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-2322110e-233a-42e0-b98b-4b527e724718 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38" status: 200 len: 1235 microversion: 2.1 time: 0.081619 Apr 14 18:52:44 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 146/430] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:52:44 2023] GET /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38 => generated 1235 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:52:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-d1bd2226-4f11-4fab-976b-fa512f66eed1 req-f2cff6e0-301d-405a-aa64-910a71e3ee9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d14a51-41aa-4827-bd60-c605d9689bc8", "name": "network-vif-plugged", "status": "completed", "tag": "b8044678-899b-4461-bbf0-cf9fd662e71e"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-d1bd2226-4f11-4fab-976b-fa512f66eed1 req-f2cff6e0-301d-405a-aa64-910a71e3ee9a service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-d1bd2226-4f11-4fab-976b-fa512f66eed1 req-f2cff6e0-301d-405a-aa64-910a71e3ee9a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-d1bd2226-4f11-4fab-976b-fa512f66eed1 req-f2cff6e0-301d-405a-aa64-910a71e3ee9a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:46 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-d1bd2226-4f11-4fab-976b-fa512f66eed1 req-f2cff6e0-301d-405a-aa64-910a71e3ee9a service nova] Creating event network-vif-plugged:b8044678-899b-4461-bbf0-cf9fd662e71e for instance 23d14a51-41aa-4827-bd60-c605d9689bc8 on user Apr 14 18:52:46 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-d1bd2226-4f11-4fab-976b-fa512f66eed1 req-f2cff6e0-301d-405a-aa64-910a71e3ee9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049393 Apr 14 18:52:46 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 142/431] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:52:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:47 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-1c152661-3367-4692-9de9-831ffea3e531 req-37174a96-e128-4259-b77d-1c3f8f2cff52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61944d61-738b-42a7-a95d-8caa6fa29a38", "tag": "62d648bd-cf77-401d-abcf-b4f95e339dc9"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:47 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-1c152661-3367-4692-9de9-831ffea3e531 req-37174a96-e128-4259-b77d-1c3f8f2cff52 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:47 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-1c152661-3367-4692-9de9-831ffea3e531 req-37174a96-e128-4259-b77d-1c3f8f2cff52 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:47 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-1c152661-3367-4692-9de9-831ffea3e531 req-37174a96-e128-4259-b77d-1c3f8f2cff52 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:47 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-1c152661-3367-4692-9de9-831ffea3e531 req-37174a96-e128-4259-b77d-1c3f8f2cff52 service nova] Creating event network-changed:62d648bd-cf77-401d-abcf-b4f95e339dc9 for instance 61944d61-738b-42a7-a95d-8caa6fa29a38 on user Apr 14 18:52:47 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-1c152661-3367-4692-9de9-831ffea3e531 req-37174a96-e128-4259-b77d-1c3f8f2cff52 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040875 Apr 14 18:52:47 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 144/432] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:52:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:48 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-280b1a65-60e2-4218-8c95-0293f648a696 req-2e1922ef-b0d3-4d2f-bed7-9d6ef626a183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d14a51-41aa-4827-bd60-c605d9689bc8", "name": "network-vif-plugged", "status": "completed", "tag": "b8044678-899b-4461-bbf0-cf9fd662e71e"}, {"server_uuid": "23d14a51-41aa-4827-bd60-c605d9689bc8", "name": "network-vif-plugged", "status": "completed", "tag": "b8044678-899b-4461-bbf0-cf9fd662e71e"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:48 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-280b1a65-60e2-4218-8c95-0293f648a696 req-2e1922ef-b0d3-4d2f-bed7-9d6ef626a183 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:48 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-280b1a65-60e2-4218-8c95-0293f648a696 req-2e1922ef-b0d3-4d2f-bed7-9d6ef626a183 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:48 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-280b1a65-60e2-4218-8c95-0293f648a696 req-2e1922ef-b0d3-4d2f-bed7-9d6ef626a183 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:48 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-280b1a65-60e2-4218-8c95-0293f648a696 req-2e1922ef-b0d3-4d2f-bed7-9d6ef626a183 service nova] Creating event network-vif-plugged:b8044678-899b-4461-bbf0-cf9fd662e71e for instance 23d14a51-41aa-4827-bd60-c605d9689bc8 on user Apr 14 18:52:48 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-280b1a65-60e2-4218-8c95-0293f648a696 req-2e1922ef-b0d3-4d2f-bed7-9d6ef626a183 service nova] Creating event network-vif-plugged:b8044678-899b-4461-bbf0-cf9fd662e71e for instance 23d14a51-41aa-4827-bd60-c605d9689bc8 on user Apr 14 18:52:48 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-280b1a65-60e2-4218-8c95-0293f648a696 req-2e1922ef-b0d3-4d2f-bed7-9d6ef626a183 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035292 Apr 14 18:52:48 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 147/433] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:52:48 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:52:50 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-9f78f8da-d100-4629-a598-01a54fd2ee94 req-1f9df2a9-b896-4f03-a90b-70a57983e790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61944d61-738b-42a7-a95d-8caa6fa29a38", "name": "network-vif-plugged", "status": "completed", "tag": "62d648bd-cf77-401d-abcf-b4f95e339dc9"}, {"server_uuid": "61944d61-738b-42a7-a95d-8caa6fa29a38", "name": "network-vif-plugged", "status": "completed", "tag": "62d648bd-cf77-401d-abcf-b4f95e339dc9"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:52:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9f78f8da-d100-4629-a598-01a54fd2ee94 req-1f9df2a9-b896-4f03-a90b-70a57983e790 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:52:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9f78f8da-d100-4629-a598-01a54fd2ee94 req-1f9df2a9-b896-4f03-a90b-70a57983e790 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:52:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9f78f8da-d100-4629-a598-01a54fd2ee94 req-1f9df2a9-b896-4f03-a90b-70a57983e790 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:52:50 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-9f78f8da-d100-4629-a598-01a54fd2ee94 req-1f9df2a9-b896-4f03-a90b-70a57983e790 service nova] Creating event network-vif-plugged:62d648bd-cf77-401d-abcf-b4f95e339dc9 for instance 61944d61-738b-42a7-a95d-8caa6fa29a38 on user Apr 14 18:52:50 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-9f78f8da-d100-4629-a598-01a54fd2ee94 req-1f9df2a9-b896-4f03-a90b-70a57983e790 service nova] Creating event network-vif-plugged:62d648bd-cf77-401d-abcf-b4f95e339dc9 for instance 61944d61-738b-42a7-a95d-8caa6fa29a38 on user Apr 14 18:52:50 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-9f78f8da-d100-4629-a598-01a54fd2ee94 req-1f9df2a9-b896-4f03-a90b-70a57983e790 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028735 Apr 14 18:52:50 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 143/434] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:52:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:03 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:03 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=10 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:03 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=3 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:03 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=29 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:03 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-8a1d6912-165e-4e6a-8c6a-7b0cef3b5ade tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:03 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-8a1d6912-165e-4e6a-8c6a-7b0cef3b5ade tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8a1d6912-165e-4e6a-8c6a-7b0cef3b5ade tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8a1d6912-165e-4e6a-8c6a-7b0cef3b5ade tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8a1d6912-165e-4e6a-8c6a-7b0cef3b5ade tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8a1d6912-165e-4e6a-8c6a-7b0cef3b5ade tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8a1d6912-165e-4e6a-8c6a-7b0cef3b5ade tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8a1d6912-165e-4e6a-8c6a-7b0cef3b5ade tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:04 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-8a1d6912-165e-4e6a-8c6a-7b0cef3b5ade tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8713ed85ffb4446847f5ded4bc2e399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60e8abd123e414f847c68ba72894689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:53:04 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-8a1d6912-165e-4e6a-8c6a-7b0cef3b5ade tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf640f3e-3d77-46ee-8a11-e0bdc870ff97" status: 200 len: 1489 microversion: 2.1 time: 0.311613 Apr 14 18:53:04 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 145/435] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:53:03 2023] GET /compute/v2.1/servers/cf640f3e-3d77-46ee-8a11-e0bdc870ff97 => generated 1489 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:53:05 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:05 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=9 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:05 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=5 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:05 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-819abe38-f5b9-43ce-9575-fdec5ebea59f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:05 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-819abe38-f5b9-43ce-9575-fdec5ebea59f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:05 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-819abe38-f5b9-43ce-9575-fdec5ebea59f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:05 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-819abe38-f5b9-43ce-9575-fdec5ebea59f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:05 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-819abe38-f5b9-43ce-9575-fdec5ebea59f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:05 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-819abe38-f5b9-43ce-9575-fdec5ebea59f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:05 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-819abe38-f5b9-43ce-9575-fdec5ebea59f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:05 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-819abe38-f5b9-43ce-9575-fdec5ebea59f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:05 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-819abe38-f5b9-43ce-9575-fdec5ebea59f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057608 Apr 14 18:53:05 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 148/436] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:53:05 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 18:53:05 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=7 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:05 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:05 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-374cfdc4-6a28-443b-b5f8-4b08f3d3d734 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:05 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-374cfdc4-6a28-443b-b5f8-4b08f3d3d734 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:05 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-374cfdc4-6a28-443b-b5f8-4b08f3d3d734 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:05 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-374cfdc4-6a28-443b-b5f8-4b08f3d3d734 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:05 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-374cfdc4-6a28-443b-b5f8-4b08f3d3d734 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:05 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-374cfdc4-6a28-443b-b5f8-4b08f3d3d734 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:05 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-374cfdc4-6a28-443b-b5f8-4b08f3d3d734 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:05 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-374cfdc4-6a28-443b-b5f8-4b08f3d3d734 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:05 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-374cfdc4-6a28-443b-b5f8-4b08f3d3d734 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:53:05 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-374cfdc4-6a28-443b-b5f8-4b08f3d3d734 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 200 len: 1675 microversion: 2.1 time: 0.283717 Apr 14 18:53:05 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 144/437] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:53:05 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 1675 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:53:05 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-a3c4138e-6647-4950-9cdd-609241cdc182 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:05 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-a3c4138e-6647-4950-9cdd-609241cdc182 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a3c4138e-6647-4950-9cdd-609241cdc182 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a3c4138e-6647-4950-9cdd-609241cdc182 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a3c4138e-6647-4950-9cdd-609241cdc182 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a3c4138e-6647-4950-9cdd-609241cdc182 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a3c4138e-6647-4950-9cdd-609241cdc182 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a3c4138e-6647-4950-9cdd-609241cdc182 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:06 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-a3c4138e-6647-4950-9cdd-609241cdc182 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:53:06 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-a3c4138e-6647-4950-9cdd-609241cdc182 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 200 len: 1675 microversion: 2.1 time: 0.288294 Apr 14 18:53:06 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 146/438] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:53:05 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 1675 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:53:06 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-8f783db3-6b9c-4213-aab7-9a1cf307017d tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:06 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-8f783db3-6b9c-4213-aab7-9a1cf307017d tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8f783db3-6b9c-4213-aab7-9a1cf307017d tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8f783db3-6b9c-4213-aab7-9a1cf307017d tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8f783db3-6b9c-4213-aab7-9a1cf307017d tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8f783db3-6b9c-4213-aab7-9a1cf307017d tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8f783db3-6b9c-4213-aab7-9a1cf307017d tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8f783db3-6b9c-4213-aab7-9a1cf307017d tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:06 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-8f783db3-6b9c-4213-aab7-9a1cf307017d tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:53:06 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-8f783db3-6b9c-4213-aab7-9a1cf307017d tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 200 len: 1675 microversion: 2.1 time: 0.159635 Apr 14 18:53:06 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 149/439] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:53:06 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:53:08 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:08 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:08 user devstack@n-api.service[61673]: DEBUG nova.objects.instance [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lazy-loading 'services' on Instance uuid 1285eca2-575b-4550-a424-605fb186b510 {{(pid=61673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 18:53:08 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1285eca2-575b-4550-a424-605fb186b510/os-volume_attachments/1966d299-f72f-45d4-91de-eff266b7e44d" status: 202 len: 0 microversion: 2.1 time: 0.182666 Apr 14 18:53:08 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 145/440] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 18:53:08 2023] DELETE /compute/v2.1/servers/1285eca2-575b-4550-a424-605fb186b510/os-volume_attachments/1966d299-f72f-45d4-91de-eff266b7e44d => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:53:08 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-fc5a5dad-00b9-46e1-a546-e515d8bf76d0 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:08 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-fc5a5dad-00b9-46e1-a546-e515d8bf76d0 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:08 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:08 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fc5a5dad-00b9-46e1-a546-e515d8bf76d0 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fc5a5dad-00b9-46e1-a546-e515d8bf76d0 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fc5a5dad-00b9-46e1-a546-e515d8bf76d0 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fc5a5dad-00b9-46e1-a546-e515d8bf76d0 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fc5a5dad-00b9-46e1-a546-e515d8bf76d0 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fc5a5dad-00b9-46e1-a546-e515d8bf76d0 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:08 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-fc5a5dad-00b9-46e1-a546-e515d8bf76d0 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] HTTP exception thrown: Instance 656b9f90-ce93-42cd-aa1b-3ff868162aae could not be found. Apr 14 18:53:08 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-fc5a5dad-00b9-46e1-a546-e515d8bf76d0 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Request method failure captured: Apr 14 18:53:08 user devstack@n-api.service[61675]: request: GET /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae HTTP/1.1 Apr 14 18:53:08 user devstack@n-api.service[61675]: Accept: application/json Apr 14 18:53:08 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 18:53:08 user devstack@n-api.service[61675]: Connection: close Apr 14 18:53:08 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 18:53:08 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 18:53:08 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 18:53:08 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 18:53:08 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 18:53:08 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOZ-jF2atbHM_lByU_PslMtdO0A0nVkr7kGVuQAm-akNwPFZSgKmoKfwLoWEfhrr5QMF2UgTOk5rIvzWw8k8iAfboO82nc4PwBwFuYK77brK2jiwQR--r0qVPIH2UN3sU9b27IssfwfkZMWqxZA_2E94J7fiHrT6oOA1O-1dwGEm2pZM Apr 14 18:53:08 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 18:53:08 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 18:53:08 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 18:53:08 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 18:53:08 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 18:53:08 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 18:53:08 user devstack@n-api.service[61675]: X-Project-Id: 8e6b4e98cf9e4f96b79c3288dfe0da89 Apr 14 18:53:08 user devstack@n-api.service[61675]: X-Project-Name: tempest-TestMinimumBasicScenario-1257841115 Apr 14 18:53:08 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 18:53:08 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 18:53:08 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8e6b4e98cf9e4f96b79c3288dfe0da89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8e6b4e98cf9e4f96b79c3288dfe0da89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8e6b4e98cf9e4f96b79c3288dfe0da89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:53:08 user devstack@n-api.service[61675]: X-Tenant: tempest-TestMinimumBasicScenario-1257841115 Apr 14 18:53:08 user devstack@n-api.service[61675]: X-Tenant-Id: 8e6b4e98cf9e4f96b79c3288dfe0da89 Apr 14 18:53:08 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1257841115 Apr 14 18:53:08 user devstack@n-api.service[61675]: X-User: tempest-TestMinimumBasicScenario-1257841115-project-member Apr 14 18:53:08 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 18:53:08 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 18:53:08 user devstack@n-api.service[61675]: X-User-Id: 67e1d31c2d9048699758779dedf7d3ac Apr 14 18:53:08 user devstack@n-api.service[61675]: X-User-Name: tempest-TestMinimumBasicScenario-1257841115-project-member Apr 14 18:53:08 user devstack@n-api.service[61675]: method: > Apr 14 18:53:08 user devstack@n-api.service[61675]: exception: Instance 656b9f90-ce93-42cd-aa1b-3ff868162aae could not be found. Apr 14 18:53:08 user devstack@n-api.service[61675]: action_args: {'id': '656b9f90-ce93-42cd-aa1b-3ff868162aae'} Apr 14 18:53:08 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 656b9f90-ce93-42cd-aa1b-3ff868162aae could not be found. Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 656b9f90-ce93-42cd-aa1b-3ff868162aae could not be found. Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 656b9f90-ce93-42cd-aa1b-3ff868162aae could not be found. Apr 14 18:53:08 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:53:08 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-fc5a5dad-00b9-46e1-a546-e515d8bf76d0 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Returning 404 to user: Instance 656b9f90-ce93-42cd-aa1b-3ff868162aae could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:53:08 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-fc5a5dad-00b9-46e1-a546-e515d8bf76d0 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae" status: 404 len: 111 microversion: 2.1 time: 0.034335 Apr 14 18:53:08 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 147/441] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:53:08 2023] GET /compute/v2.1/servers/656b9f90-ce93-42cd-aa1b-3ff868162aae => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:53:08 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Going to try to terminate instance {{(pid=61674) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 18:53:08 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-d69a4146-3c4f-4332-9e55-6f522736f594 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '.version_select at 0x7fdae1036830>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:08 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-d69a4146-3c4f-4332-9e55-6f522736f594 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-299923261" status: 202 len: 0 microversion: 2.1 time: 0.023431 Apr 14 18:53:08 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 146/442] 10.0.0.210 () {62 vars in 1346 bytes} [Fri Apr 14 18:53:08 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-299923261 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:53:08 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1285eca2-575b-4550-a424-605fb186b510" status: 204 len: 0 microversion: 2.1 time: 0.137948 Apr 14 18:53:08 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 150/443] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 18:53:08 2023] DELETE /compute/v2.1/servers/1285eca2-575b-4550-a424-605fb186b510 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 18:53:08 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-f178fa55-3682-4441-9386-7395fe2f4e3a tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:08 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-f178fa55-3682-4441-9386-7395fe2f4e3a tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f178fa55-3682-4441-9386-7395fe2f4e3a tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f178fa55-3682-4441-9386-7395fe2f4e3a tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f178fa55-3682-4441-9386-7395fe2f4e3a tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f178fa55-3682-4441-9386-7395fe2f4e3a tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f178fa55-3682-4441-9386-7395fe2f4e3a tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f178fa55-3682-4441-9386-7395fe2f4e3a tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:08 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-f178fa55-3682-4441-9386-7395fe2f4e3a tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3f788e144c46e7bdf6f4fe3a5aeb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95319509fb6a4e58998703975370877a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:53:08 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-f178fa55-3682-4441-9386-7395fe2f4e3a tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1285eca2-575b-4550-a424-605fb186b510" status: 200 len: 1548 microversion: 2.1 time: 0.240760 Apr 14 18:53:08 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 148/444] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:53:08 2023] GET /compute/v2.1/servers/1285eca2-575b-4550-a424-605fb186b510 => generated 1548 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:53:10 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-4327a20c-9a22-4a9b-893d-438d5e9d43ec req-36e7901c-a0e2-41c2-9363-3b781f8619e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1285eca2-575b-4550-a424-605fb186b510", "name": "network-vif-unplugged", "status": "completed", "tag": "0ccfdc96-01f1-414d-8693-963f116cfd62"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:53:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-4327a20c-9a22-4a9b-893d-438d5e9d43ec req-36e7901c-a0e2-41c2-9363-3b781f8619e1 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-4327a20c-9a22-4a9b-893d-438d5e9d43ec req-36e7901c-a0e2-41c2-9363-3b781f8619e1 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-4327a20c-9a22-4a9b-893d-438d5e9d43ec req-36e7901c-a0e2-41c2-9363-3b781f8619e1 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:10 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-4327a20c-9a22-4a9b-893d-438d5e9d43ec req-36e7901c-a0e2-41c2-9363-3b781f8619e1 service nova] Creating event network-vif-unplugged:0ccfdc96-01f1-414d-8693-963f116cfd62 for instance 1285eca2-575b-4550-a424-605fb186b510 on user Apr 14 18:53:10 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-4327a20c-9a22-4a9b-893d-438d5e9d43ec req-36e7901c-a0e2-41c2-9363-3b781f8619e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044507 Apr 14 18:53:10 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 147/445] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:53:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:10 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-7eec2e01-d1c9-4a23-af68-dc2a1eeca86a tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Action: 'create', calling method: .version_select at 0x7fdae114a8c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1594101407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOqKy4QJH9Ahk78Dio5o1pKmdxgls1Vij0F1hpELGXEH2iLM2PcaG5f/FMMxqCoIhYjKPIFlM0PNsjOP/N9XDX+woRo9QWFmiSBk1ThRc0RqtjvABAaJ1upzg7Tk3FDAQ=="}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:53:10 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-7eec2e01-d1c9-4a23-af68-dc2a1eeca86a tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Getting quotas for project 8e6b4e98cf9e4f96b79c3288dfe0da89. Resources: {'key_pairs'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:53:10 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-7eec2e01-d1c9-4a23-af68-dc2a1eeca86a tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Getting quotas for user 67e1d31c2d9048699758779dedf7d3ac and project 8e6b4e98cf9e4f96b79c3288dfe0da89. Resources: {'key_pairs'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:53:10 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-7eec2e01-d1c9-4a23-af68-dc2a1eeca86a tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.056892 Apr 14 18:53:10 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 151/446] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 18:53:10 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:10 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1520840237", "imageRef": "820f1452-474e-4205-aea7-0d8c120229da", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1594101407", "networks": [{"uuid": "abf4a6b2-999d-423c-8c7b-f0f773160410"}]}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:53:10 user devstack@n-api.service[61675]: DEBUG nova.network.neutron [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] validate_networks() for [('abf4a6b2-999d-423c-8c7b-f0f773160410', None, None, None, None, None)] {{(pid=61675) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:53:11 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Flavor limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:53:11 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Image limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:53:11 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Flavor pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:53:11 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Image pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:53:11 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:53:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:11 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Getting quotas for project 8e6b4e98cf9e4f96b79c3288dfe0da89. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:53:11 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Getting quotas for user 67e1d31c2d9048699758779dedf7d3ac and project 8e6b4e98cf9e4f96b79c3288dfe0da89. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:53:11 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Going to run 1 instances... {{(pid=61675) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:53:11 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='820f1452-474e-4205-aea7-0d8c120229da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:53:11 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.765913 Apr 14 18:53:11 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 149/447] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:53:10 2023] POST /compute/v2.1/servers => generated 378 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:53:11 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-29de16e5-76a2-49e1-9ccf-06f865fa4427 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:11 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-29de16e5-76a2-49e1-9ccf-06f865fa4427 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:11 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-29de16e5-76a2-49e1-9ccf-06f865fa4427 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e1d31c2d9048699758779dedf7d3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6b4e98cf9e4f96b79c3288dfe0da89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:53:11 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-29de16e5-76a2-49e1-9ccf-06f865fa4427 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653" status: 200 len: 1253 microversion: 2.1 time: 0.070860 Apr 14 18:53:11 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 148/448] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:53:11 2023] GET /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653 => generated 1253 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:53:12 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-63966037-0f48-48db-986b-5e130b0774af req-88cbdf4e-f468-41b6-b87c-6909173970f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1285eca2-575b-4550-a424-605fb186b510", "name": "network-vif-plugged", "status": "completed", "tag": "0ccfdc96-01f1-414d-8693-963f116cfd62"}, {"server_uuid": "1285eca2-575b-4550-a424-605fb186b510", "name": "network-vif-deleted", "tag": "0ccfdc96-01f1-414d-8693-963f116cfd62"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:53:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-63966037-0f48-48db-986b-5e130b0774af req-88cbdf4e-f468-41b6-b87c-6909173970f3 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-63966037-0f48-48db-986b-5e130b0774af req-88cbdf4e-f468-41b6-b87c-6909173970f3 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-63966037-0f48-48db-986b-5e130b0774af req-88cbdf4e-f468-41b6-b87c-6909173970f3 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:12 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-63966037-0f48-48db-986b-5e130b0774af req-88cbdf4e-f468-41b6-b87c-6909173970f3 service nova] Creating event network-vif-plugged:0ccfdc96-01f1-414d-8693-963f116cfd62 for instance 1285eca2-575b-4550-a424-605fb186b510 on user Apr 14 18:53:12 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-63966037-0f48-48db-986b-5e130b0774af req-88cbdf4e-f468-41b6-b87c-6909173970f3 service nova] Creating event network-vif-deleted:0ccfdc96-01f1-414d-8693-963f116cfd62 for instance 1285eca2-575b-4550-a424-605fb186b510 on user Apr 14 18:53:12 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-63966037-0f48-48db-986b-5e130b0774af req-88cbdf4e-f468-41b6-b87c-6909173970f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030776 Apr 14 18:53:12 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 152/449] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:53:12 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:14 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-485ab1cf-c559-42d9-b248-e4e73ae8d0d9 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:14 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-485ab1cf-c559-42d9-b248-e4e73ae8d0d9 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-485ab1cf-c559-42d9-b248-e4e73ae8d0d9 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-485ab1cf-c559-42d9-b248-e4e73ae8d0d9 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-485ab1cf-c559-42d9-b248-e4e73ae8d0d9 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-485ab1cf-c559-42d9-b248-e4e73ae8d0d9 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-485ab1cf-c559-42d9-b248-e4e73ae8d0d9 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-485ab1cf-c559-42d9-b248-e4e73ae8d0d9 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:14 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-4e8b0078-41d8-4508-866e-27f9c1bf2da0 req-b6b86a32-5895-4bc8-93ae-ca751be9ef63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cab14831-868c-40aa-b694-9e0185557653", "tag": "00582309-5b1a-4a4d-80b2-478c8f9ada29"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:53:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-4e8b0078-41d8-4508-866e-27f9c1bf2da0 req-b6b86a32-5895-4bc8-93ae-ca751be9ef63 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-4e8b0078-41d8-4508-866e-27f9c1bf2da0 req-b6b86a32-5895-4bc8-93ae-ca751be9ef63 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-4e8b0078-41d8-4508-866e-27f9c1bf2da0 req-b6b86a32-5895-4bc8-93ae-ca751be9ef63 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:14 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-485ab1cf-c559-42d9-b248-e4e73ae8d0d9 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] HTTP exception thrown: Instance 817f112c-d806-4800-9e4a-a3892c54bee1 could not be found. Apr 14 18:53:14 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-485ab1cf-c559-42d9-b248-e4e73ae8d0d9 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Request method failure captured: Apr 14 18:53:14 user devstack@n-api.service[61675]: request: GET /compute/v2.1/servers/817f112c-d806-4800-9e4a-a3892c54bee1 HTTP/1.1 Apr 14 18:53:14 user devstack@n-api.service[61675]: Accept: application/json Apr 14 18:53:14 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 18:53:14 user devstack@n-api.service[61675]: Connection: close Apr 14 18:53:14 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 18:53:14 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 18:53:14 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 18:53:14 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 18:53:14 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 18:53:14 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOZ91Dy52y80HoUx_25txBgAmdKy_dzVjWjY1ksSEjioYtZS_I_NYqQvpViXWkKPnxgf56UahBdEppDz8gnLZadIBfA0bvGJo_tJO0X624LWTeHmN5ztGzSPLT3ogEGrsduTHdRctRKOcdHh9YBu4Kq1db7JzZe-LLVD5zRuDGi5LnSs Apr 14 18:53:14 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 18:53:14 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 18:53:14 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 18:53:14 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 18:53:14 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 18:53:14 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 18:53:14 user devstack@n-api.service[61675]: X-Project-Id: d22a362d9cb946a99c203366f88baafb Apr 14 18:53:14 user devstack@n-api.service[61675]: X-Project-Name: tempest-VolumesAdminNegativeTest-714849235 Apr 14 18:53:14 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 18:53:14 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 18:53:14 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d22a362d9cb946a99c203366f88baafb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d22a362d9cb946a99c203366f88baafb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d22a362d9cb946a99c203366f88baafb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:53:14 user devstack@n-api.service[61675]: X-Tenant: tempest-VolumesAdminNegativeTest-714849235 Apr 14 18:53:14 user devstack@n-api.service[61675]: X-Tenant-Id: d22a362d9cb946a99c203366f88baafb Apr 14 18:53:14 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-714849235 Apr 14 18:53:14 user devstack@n-api.service[61675]: X-User: tempest-VolumesAdminNegativeTest-714849235-project-member Apr 14 18:53:14 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 18:53:14 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 18:53:14 user devstack@n-api.service[61675]: X-User-Id: 3f78850ecd8042dbac5f24113b9df70e Apr 14 18:53:14 user devstack@n-api.service[61675]: X-User-Name: tempest-VolumesAdminNegativeTest-714849235-project-member Apr 14 18:53:14 user devstack@n-api.service[61675]: method: > Apr 14 18:53:14 user devstack@n-api.service[61675]: exception: Instance 817f112c-d806-4800-9e4a-a3892c54bee1 could not be found. Apr 14 18:53:14 user devstack@n-api.service[61675]: action_args: {'id': '817f112c-d806-4800-9e4a-a3892c54bee1'} Apr 14 18:53:14 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 817f112c-d806-4800-9e4a-a3892c54bee1 could not be found. Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 817f112c-d806-4800-9e4a-a3892c54bee1 could not be found. Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 817f112c-d806-4800-9e4a-a3892c54bee1 could not be found. Apr 14 18:53:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:53:14 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-485ab1cf-c559-42d9-b248-e4e73ae8d0d9 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Returning 404 to user: Instance 817f112c-d806-4800-9e4a-a3892c54bee1 could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:53:14 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-485ab1cf-c559-42d9-b248-e4e73ae8d0d9 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/817f112c-d806-4800-9e4a-a3892c54bee1" status: 404 len: 111 microversion: 2.1 time: 0.046853 Apr 14 18:53:14 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 150/450] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:53:14 2023] GET /compute/v2.1/servers/817f112c-d806-4800-9e4a-a3892c54bee1 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:53:14 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-4e8b0078-41d8-4508-866e-27f9c1bf2da0 req-b6b86a32-5895-4bc8-93ae-ca751be9ef63 service nova] Creating event network-changed:00582309-5b1a-4a4d-80b2-478c8f9ada29 for instance cab14831-868c-40aa-b694-9e0185557653 on user Apr 14 18:53:14 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-4e8b0078-41d8-4508-866e-27f9c1bf2da0 req-b6b86a32-5895-4bc8-93ae-ca751be9ef63 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034346 Apr 14 18:53:14 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 149/451] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:53:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:14 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-5b333f33-c901-4534-bdad-2ab40e15ba07 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Calling method '.version_select at 0x7fdae1022b90>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:14 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-5b333f33-c901-4534-bdad-2ab40e15ba07 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-397111654" status: 202 len: 0 microversion: 2.1 time: 0.021918 Apr 14 18:53:14 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 153/452] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 18:53:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-397111654 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:53:16 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-1572d188-314d-4f51-9ab6-fe44581e5d2c req-a4b947f8-9e78-4e95-98ca-b51f160ef6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab14831-868c-40aa-b694-9e0185557653", "name": "network-vif-plugged", "status": "completed", "tag": "00582309-5b1a-4a4d-80b2-478c8f9ada29"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:53:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-1572d188-314d-4f51-9ab6-fe44581e5d2c req-a4b947f8-9e78-4e95-98ca-b51f160ef6b0 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-1572d188-314d-4f51-9ab6-fe44581e5d2c req-a4b947f8-9e78-4e95-98ca-b51f160ef6b0 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-1572d188-314d-4f51-9ab6-fe44581e5d2c req-a4b947f8-9e78-4e95-98ca-b51f160ef6b0 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:16 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-1572d188-314d-4f51-9ab6-fe44581e5d2c req-a4b947f8-9e78-4e95-98ca-b51f160ef6b0 service nova] Creating event network-vif-plugged:00582309-5b1a-4a4d-80b2-478c8f9ada29 for instance cab14831-868c-40aa-b694-9e0185557653 on user Apr 14 18:53:16 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-1572d188-314d-4f51-9ab6-fe44581e5d2c req-a4b947f8-9e78-4e95-98ca-b51f160ef6b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036274 Apr 14 18:53:16 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 151/453] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:53:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:18 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-b693144b-18d9-4f13-9e88-eb17833b9695 req-e7915431-8c15-4d66-8d23-da43c5ab5c5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab14831-868c-40aa-b694-9e0185557653", "name": "network-vif-plugged", "status": "completed", "tag": "00582309-5b1a-4a4d-80b2-478c8f9ada29"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:53:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-b693144b-18d9-4f13-9e88-eb17833b9695 req-e7915431-8c15-4d66-8d23-da43c5ab5c5c service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-b693144b-18d9-4f13-9e88-eb17833b9695 req-e7915431-8c15-4d66-8d23-da43c5ab5c5c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-b693144b-18d9-4f13-9e88-eb17833b9695 req-e7915431-8c15-4d66-8d23-da43c5ab5c5c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:18 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-b693144b-18d9-4f13-9e88-eb17833b9695 req-e7915431-8c15-4d66-8d23-da43c5ab5c5c service nova] Creating event network-vif-plugged:00582309-5b1a-4a4d-80b2-478c8f9ada29 for instance cab14831-868c-40aa-b694-9e0185557653 on user Apr 14 18:53:18 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-b693144b-18d9-4f13-9e88-eb17833b9695 req-e7915431-8c15-4d66-8d23-da43c5ab5c5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037725 Apr 14 18:53:18 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 150/454] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:53:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 18:53:20 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-e5fcd561-ab9f-479b-aeb3-748f32b2d64c tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:20 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-e5fcd561-ab9f-479b-aeb3-748f32b2d64c tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:20 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e5fcd561-ab9f-479b-aeb3-748f32b2d64c tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:20 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e5fcd561-ab9f-479b-aeb3-748f32b2d64c tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:20 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e5fcd561-ab9f-479b-aeb3-748f32b2d64c tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:20 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e5fcd561-ab9f-479b-aeb3-748f32b2d64c tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:20 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e5fcd561-ab9f-479b-aeb3-748f32b2d64c tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:20 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e5fcd561-ab9f-479b-aeb3-748f32b2d64c tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:20 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-e5fcd561-ab9f-479b-aeb3-748f32b2d64c tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] HTTP exception thrown: Instance dc260db7-ffd6-4b7a-8b70-b4070478faab could not be found. Apr 14 18:53:20 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-e5fcd561-ab9f-479b-aeb3-748f32b2d64c tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Request method failure captured: Apr 14 18:53:20 user devstack@n-api.service[61674]: request: GET /compute/v2.1/servers/dc260db7-ffd6-4b7a-8b70-b4070478faab HTTP/1.1 Apr 14 18:53:20 user devstack@n-api.service[61674]: Accept: application/json Apr 14 18:53:20 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 18:53:20 user devstack@n-api.service[61674]: Connection: close Apr 14 18:53:20 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 18:53:20 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 18:53:20 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 18:53:20 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 18:53:20 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 18:53:20 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOaBXPghHMx7bthxYpj5RimcCT-TnsDO1Iqpk0QRbjfZ85bdf3qUKSENOmNFwkcnr3rwTxd7-G8zXN9zje1-vPSW5dsCy7ay9_efC8-zdyrAdZ1W_Z11Ah-nN17sQEvuMC3Ga58H-f0mSOpgvfpqoHzjKlxbi4w_p2PIrGp8WKHNgT_c Apr 14 18:53:20 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 18:53:20 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 18:53:20 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 18:53:20 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 18:53:20 user devstack@n-api.service[61674]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 18:53:20 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 18:53:20 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 18:53:20 user devstack@n-api.service[61674]: X-Project-Id: 5c49bffa4d8e4f92a54ad17a5f5db634 Apr 14 18:53:20 user devstack@n-api.service[61674]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-632155347 Apr 14 18:53:20 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 18:53:20 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 18:53:20 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c49bffa4d8e4f92a54ad17a5f5db634"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5c49bffa4d8e4f92a54ad17a5f5db634"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c49bffa4d8e4f92a54ad17a5f5db634"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:53:20 user devstack@n-api.service[61674]: X-Tenant: tempest-TaggedBootDevicesTest_v242-632155347 Apr 14 18:53:20 user devstack@n-api.service[61674]: X-Tenant-Id: 5c49bffa4d8e4f92a54ad17a5f5db634 Apr 14 18:53:20 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-632155347 Apr 14 18:53:20 user devstack@n-api.service[61674]: X-User: tempest-TaggedBootDevicesTest_v242-632155347-project-member Apr 14 18:53:20 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 18:53:20 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 18:53:20 user devstack@n-api.service[61674]: X-User-Id: 9ee19795311144e69dd00db0403cb8b1 Apr 14 18:53:20 user devstack@n-api.service[61674]: X-User-Name: tempest-TaggedBootDevicesTest_v242-632155347-project-member Apr 14 18:53:20 user devstack@n-api.service[61674]: method: > Apr 14 18:53:20 user devstack@n-api.service[61674]: exception: Instance dc260db7-ffd6-4b7a-8b70-b4070478faab could not be found. Apr 14 18:53:20 user devstack@n-api.service[61674]: action_args: {'id': 'dc260db7-ffd6-4b7a-8b70-b4070478faab'} Apr 14 18:53:20 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc260db7-ffd6-4b7a-8b70-b4070478faab could not be found. Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc260db7-ffd6-4b7a-8b70-b4070478faab could not be found. Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc260db7-ffd6-4b7a-8b70-b4070478faab could not be found. Apr 14 18:53:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:53:20 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-e5fcd561-ab9f-479b-aeb3-748f32b2d64c tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Returning 404 to user: Instance dc260db7-ffd6-4b7a-8b70-b4070478faab could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:53:20 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-e5fcd561-ab9f-479b-aeb3-748f32b2d64c tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc260db7-ffd6-4b7a-8b70-b4070478faab" status: 404 len: 111 microversion: 2.42 time: 0.063124 Apr 14 18:53:20 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 154/455] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:53:20 2023] GET /compute/v2.1/servers/dc260db7-ffd6-4b7a-8b70-b4070478faab => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 18:53:20 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-b8697d3b-530b-4e88-b221-6d4ddf346ced tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Calling method '.version_select at 0x7fdae11ed090>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:20 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-b8697d3b-530b-4e88-b221-6d4ddf346ced tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1346818342" status: 204 len: 0 microversion: 2.42 time: 0.024745 Apr 14 18:53:20 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 152/456] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 18:53:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1346818342 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 14 18:53:22 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:22 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-ab3bebbd-180d-4b11-aef6-1f1feaa23774 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:22 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-ab3bebbd-180d-4b11-aef6-1f1feaa23774 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ab3bebbd-180d-4b11-aef6-1f1feaa23774 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ab3bebbd-180d-4b11-aef6-1f1feaa23774 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ab3bebbd-180d-4b11-aef6-1f1feaa23774 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ab3bebbd-180d-4b11-aef6-1f1feaa23774 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ab3bebbd-180d-4b11-aef6-1f1feaa23774 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ab3bebbd-180d-4b11-aef6-1f1feaa23774 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:22 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-ab3bebbd-180d-4b11-aef6-1f1feaa23774 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.344193 Apr 14 18:53:22 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 151/457] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 18:53:22 2023] GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/os-interface => generated 282 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:23 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-e6bb9a42-7500-465c-9eee-aa5443b13ca2 req-dde76c9f-87d3-41a1-8ba0-48198ebb43d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0050e6bb-0b53-4fdc-8437-16b94ee79fa4", "tag": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:53:23 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=4 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-e6bb9a42-7500-465c-9eee-aa5443b13ca2 req-dde76c9f-87d3-41a1-8ba0-48198ebb43d0 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-e6bb9a42-7500-465c-9eee-aa5443b13ca2 req-dde76c9f-87d3-41a1-8ba0-48198ebb43d0 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-e6bb9a42-7500-465c-9eee-aa5443b13ca2 req-dde76c9f-87d3-41a1-8ba0-48198ebb43d0 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:23 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-e6bb9a42-7500-465c-9eee-aa5443b13ca2 req-dde76c9f-87d3-41a1-8ba0-48198ebb43d0 service nova] Creating event network-changed:2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 on user Apr 14 18:53:23 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-e6bb9a42-7500-465c-9eee-aa5443b13ca2 req-dde76c9f-87d3-41a1-8ba0-48198ebb43d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052346 Apr 14 18:53:23 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 155/458] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:53:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:23 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:23 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=6 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:23 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-32c522f2-87c1-41e2-a546-db84bd76a840 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:23 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-32c522f2-87c1-41e2-a546-db84bd76a840 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-32c522f2-87c1-41e2-a546-db84bd76a840 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-32c522f2-87c1-41e2-a546-db84bd76a840 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-32c522f2-87c1-41e2-a546-db84bd76a840 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-32c522f2-87c1-41e2-a546-db84bd76a840 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-32c522f2-87c1-41e2-a546-db84bd76a840 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-32c522f2-87c1-41e2-a546-db84bd76a840 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:23 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-32c522f2-87c1-41e2-a546-db84bd76a840 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/ips" status: 200 len: 104 microversion: 2.1 time: 0.048325 Apr 14 18:53:23 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 153/459] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 18:53:23 2023] GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/ips => generated 104 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 18:53:24 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-5c09fd46-8ee7-4b96-b4bb-456018dd2c8e tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:24 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-5c09fd46-8ee7-4b96-b4bb-456018dd2c8e tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5c09fd46-8ee7-4b96-b4bb-456018dd2c8e tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5c09fd46-8ee7-4b96-b4bb-456018dd2c8e tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5c09fd46-8ee7-4b96-b4bb-456018dd2c8e tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5c09fd46-8ee7-4b96-b4bb-456018dd2c8e tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5c09fd46-8ee7-4b96-b4bb-456018dd2c8e tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5c09fd46-8ee7-4b96-b4bb-456018dd2c8e tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:24 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-5c09fd46-8ee7-4b96-b4bb-456018dd2c8e tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054146 Apr 14 18:53:24 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 152/460] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:53:24 2023] GET /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 18:53:25 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-17e7f043-293c-455b-9b43-e9fcd80f3cb0 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:25 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-17e7f043-293c-455b-9b43-e9fcd80f3cb0 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-17e7f043-293c-455b-9b43-e9fcd80f3cb0 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-17e7f043-293c-455b-9b43-e9fcd80f3cb0 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-17e7f043-293c-455b-9b43-e9fcd80f3cb0 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-17e7f043-293c-455b-9b43-e9fcd80f3cb0 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-17e7f043-293c-455b-9b43-e9fcd80f3cb0 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-17e7f043-293c-455b-9b43-e9fcd80f3cb0 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:25 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-17e7f043-293c-455b-9b43-e9fcd80f3cb0 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] HTTP exception thrown: Instance dc260db7-ffd6-4b7a-8b70-b4070478faab could not be found. Apr 14 18:53:25 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-17e7f043-293c-455b-9b43-e9fcd80f3cb0 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Request method failure captured: Apr 14 18:53:25 user devstack@n-api.service[61674]: request: DELETE /compute/v2.1/servers/dc260db7-ffd6-4b7a-8b70-b4070478faab HTTP/1.1 Apr 14 18:53:25 user devstack@n-api.service[61674]: Accept: application/json Apr 14 18:53:25 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 18:53:25 user devstack@n-api.service[61674]: Connection: close Apr 14 18:53:25 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 18:53:25 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 18:53:25 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 18:53:25 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 18:53:25 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 18:53:25 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOaBXPghHMx7bthxYpj5RimcCT-TnsDO1Iqpk0QRbjfZ85bdf3qUKSENOmNFwkcnr3rwTxd7-G8zXN9zje1-vPSW5dsCy7ay9_efC8-zdyrAdZ1W_Z11Ah-nN17sQEvuMC3Ga58H-f0mSOpgvfpqoHzjKlxbi4w_p2PIrGp8WKHNgT_c Apr 14 18:53:25 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 18:53:25 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 18:53:25 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 18:53:25 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 18:53:25 user devstack@n-api.service[61674]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 18:53:25 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 18:53:25 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 18:53:25 user devstack@n-api.service[61674]: X-Project-Id: 5c49bffa4d8e4f92a54ad17a5f5db634 Apr 14 18:53:25 user devstack@n-api.service[61674]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-632155347 Apr 14 18:53:25 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 18:53:25 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 18:53:25 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c49bffa4d8e4f92a54ad17a5f5db634"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5c49bffa4d8e4f92a54ad17a5f5db634"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c49bffa4d8e4f92a54ad17a5f5db634"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:53:25 user devstack@n-api.service[61674]: X-Tenant: tempest-TaggedBootDevicesTest_v242-632155347 Apr 14 18:53:25 user devstack@n-api.service[61674]: X-Tenant-Id: 5c49bffa4d8e4f92a54ad17a5f5db634 Apr 14 18:53:25 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-632155347 Apr 14 18:53:25 user devstack@n-api.service[61674]: X-User: tempest-TaggedBootDevicesTest_v242-632155347-project-member Apr 14 18:53:25 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 18:53:25 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 18:53:25 user devstack@n-api.service[61674]: X-User-Id: 9ee19795311144e69dd00db0403cb8b1 Apr 14 18:53:25 user devstack@n-api.service[61674]: X-User-Name: tempest-TaggedBootDevicesTest_v242-632155347-project-member Apr 14 18:53:25 user devstack@n-api.service[61674]: method: > Apr 14 18:53:25 user devstack@n-api.service[61674]: exception: Instance dc260db7-ffd6-4b7a-8b70-b4070478faab could not be found. Apr 14 18:53:25 user devstack@n-api.service[61674]: action_args: {'id': 'dc260db7-ffd6-4b7a-8b70-b4070478faab'} Apr 14 18:53:25 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc260db7-ffd6-4b7a-8b70-b4070478faab could not be found. Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc260db7-ffd6-4b7a-8b70-b4070478faab could not be found. Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc260db7-ffd6-4b7a-8b70-b4070478faab could not be found. Apr 14 18:53:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:53:25 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-17e7f043-293c-455b-9b43-e9fcd80f3cb0 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Returning 404 to user: Instance dc260db7-ffd6-4b7a-8b70-b4070478faab could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:53:25 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-17e7f043-293c-455b-9b43-e9fcd80f3cb0 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dc260db7-ffd6-4b7a-8b70-b4070478faab" status: 404 len: 111 microversion: 2.42 time: 0.050884 Apr 14 18:53:25 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 156/461] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 18:53:25 2023] DELETE /compute/v2.1/servers/dc260db7-ffd6-4b7a-8b70-b4070478faab => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 18:53:25 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-1f4e2193-60ba-44a3-9471-feb37169e110 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:25 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-1f4e2193-60ba-44a3-9471-feb37169e110 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1f4e2193-60ba-44a3-9471-feb37169e110 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1f4e2193-60ba-44a3-9471-feb37169e110 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1f4e2193-60ba-44a3-9471-feb37169e110 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1f4e2193-60ba-44a3-9471-feb37169e110 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1f4e2193-60ba-44a3-9471-feb37169e110 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1f4e2193-60ba-44a3-9471-feb37169e110 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:25 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-1f4e2193-60ba-44a3-9471-feb37169e110 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] HTTP exception thrown: Instance dc260db7-ffd6-4b7a-8b70-b4070478faab could not be found. Apr 14 18:53:25 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-1f4e2193-60ba-44a3-9471-feb37169e110 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Request method failure captured: Apr 14 18:53:25 user devstack@n-api.service[61675]: request: GET /compute/v2.1/servers/dc260db7-ffd6-4b7a-8b70-b4070478faab HTTP/1.1 Apr 14 18:53:25 user devstack@n-api.service[61675]: Accept: application/json Apr 14 18:53:25 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 18:53:25 user devstack@n-api.service[61675]: Connection: close Apr 14 18:53:25 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 18:53:25 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 18:53:25 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 18:53:25 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 18:53:25 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 18:53:25 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOaBXPghHMx7bthxYpj5RimcCT-TnsDO1Iqpk0QRbjfZ85bdf3qUKSENOmNFwkcnr3rwTxd7-G8zXN9zje1-vPSW5dsCy7ay9_efC8-zdyrAdZ1W_Z11Ah-nN17sQEvuMC3Ga58H-f0mSOpgvfpqoHzjKlxbi4w_p2PIrGp8WKHNgT_c Apr 14 18:53:25 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 18:53:25 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 18:53:25 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 18:53:25 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 18:53:25 user devstack@n-api.service[61675]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 18:53:25 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 18:53:25 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 18:53:25 user devstack@n-api.service[61675]: X-Project-Id: 5c49bffa4d8e4f92a54ad17a5f5db634 Apr 14 18:53:25 user devstack@n-api.service[61675]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-632155347 Apr 14 18:53:25 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 18:53:25 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 18:53:25 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c49bffa4d8e4f92a54ad17a5f5db634"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5c49bffa4d8e4f92a54ad17a5f5db634"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c49bffa4d8e4f92a54ad17a5f5db634"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:53:25 user devstack@n-api.service[61675]: X-Tenant: tempest-TaggedBootDevicesTest_v242-632155347 Apr 14 18:53:25 user devstack@n-api.service[61675]: X-Tenant-Id: 5c49bffa4d8e4f92a54ad17a5f5db634 Apr 14 18:53:25 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-632155347 Apr 14 18:53:25 user devstack@n-api.service[61675]: X-User: tempest-TaggedBootDevicesTest_v242-632155347-project-member Apr 14 18:53:25 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 18:53:25 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 18:53:25 user devstack@n-api.service[61675]: X-User-Id: 9ee19795311144e69dd00db0403cb8b1 Apr 14 18:53:25 user devstack@n-api.service[61675]: X-User-Name: tempest-TaggedBootDevicesTest_v242-632155347-project-member Apr 14 18:53:25 user devstack@n-api.service[61675]: method: > Apr 14 18:53:25 user devstack@n-api.service[61675]: exception: Instance dc260db7-ffd6-4b7a-8b70-b4070478faab could not be found. Apr 14 18:53:25 user devstack@n-api.service[61675]: action_args: {'id': 'dc260db7-ffd6-4b7a-8b70-b4070478faab'} Apr 14 18:53:25 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc260db7-ffd6-4b7a-8b70-b4070478faab could not be found. Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc260db7-ffd6-4b7a-8b70-b4070478faab could not be found. Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc260db7-ffd6-4b7a-8b70-b4070478faab could not be found. Apr 14 18:53:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:53:25 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-1f4e2193-60ba-44a3-9471-feb37169e110 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Returning 404 to user: Instance dc260db7-ffd6-4b7a-8b70-b4070478faab could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:53:25 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-1f4e2193-60ba-44a3-9471-feb37169e110 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc260db7-ffd6-4b7a-8b70-b4070478faab" status: 404 len: 111 microversion: 2.42 time: 0.076311 Apr 14 18:53:25 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 154/462] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:53:25 2023] GET /compute/v2.1/servers/dc260db7-ffd6-4b7a-8b70-b4070478faab => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 18:53:26 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8870d3d7-990b-4d4c-8d7a-4591106f1a3a"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:53:26 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:26 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.386980 Apr 14 18:53:26 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 153/463] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 18:53:26 2023] POST /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/os-volume_attachments => generated 194 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:29 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-2eb8598e-29ac-43d1-b406-b914a4857067 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Calling method '.version_select at 0x7fdae1023d00>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:29 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-2eb8598e-29ac-43d1-b406-b914a4857067 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/6e8245ec-8367-4bce-99df-352eae7f4ed7" status: 204 len: 0 microversion: 2.1 time: 0.328047 Apr 14 18:53:29 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 157/464] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:53:29 2023] DELETE /compute/v2.1/images/6e8245ec-8367-4bce-99df-352eae7f4ed7 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 18:53:29 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:29 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:29 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:29 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:29 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:29 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:29 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:29 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:29 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Going to try to terminate instance {{(pid=61675) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 18:53:29 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c" status: 204 len: 0 microversion: 2.1 time: 0.164591 Apr 14 18:53:29 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 155/465] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 18:53:29 2023] DELETE /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 18:53:29 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-713af353-29df-4d46-a10a-12e4afa1b803 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:29 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-713af353-29df-4d46-a10a-12e4afa1b803 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-713af353-29df-4d46-a10a-12e4afa1b803 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-713af353-29df-4d46-a10a-12e4afa1b803 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-713af353-29df-4d46-a10a-12e4afa1b803 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-713af353-29df-4d46-a10a-12e4afa1b803 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-713af353-29df-4d46-a10a-12e4afa1b803 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-713af353-29df-4d46-a10a-12e4afa1b803 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:30 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-4982dbf7-d0ef-4186-bdfc-01b0f85f2c9f req-ce7dd465-ad69-424e-9535-7912243aa832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e55c721-9fad-4478-9e74-e87d0c95bc3c", "name": "network-vif-unplugged", "status": "completed", "tag": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:53:30 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-4982dbf7-d0ef-4186-bdfc-01b0f85f2c9f req-ce7dd465-ad69-424e-9535-7912243aa832 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:30 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-4982dbf7-d0ef-4186-bdfc-01b0f85f2c9f req-ce7dd465-ad69-424e-9535-7912243aa832 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:30 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-4982dbf7-d0ef-4186-bdfc-01b0f85f2c9f req-ce7dd465-ad69-424e-9535-7912243aa832 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:30 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-4982dbf7-d0ef-4186-bdfc-01b0f85f2c9f req-ce7dd465-ad69-424e-9535-7912243aa832 service nova] Creating event network-vif-unplugged:66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c on user Apr 14 18:53:30 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-4982dbf7-d0ef-4186-bdfc-01b0f85f2c9f req-ce7dd465-ad69-424e-9535-7912243aa832 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068460 Apr 14 18:53:30 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 158/466] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:53:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:30 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-713af353-29df-4d46-a10a-12e4afa1b803 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ed7885e7774691b02c19cf08c2177f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d84c59848f445a90eb7eab6be04253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:53:30 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-713af353-29df-4d46-a10a-12e4afa1b803 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c" status: 200 len: 1679 microversion: 2.1 time: 0.588264 Apr 14 18:53:30 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 154/467] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:53:29 2023] GET /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c => generated 1679 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:53:32 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-87bbca02-274d-4e28-9ad4-2b59fb0aebeb req-c44cf6de-38ae-46ca-89bd-62ce68e86996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e55c721-9fad-4478-9e74-e87d0c95bc3c", "name": "network-vif-plugged", "status": "completed", "tag": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:53:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-87bbca02-274d-4e28-9ad4-2b59fb0aebeb req-c44cf6de-38ae-46ca-89bd-62ce68e86996 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-87bbca02-274d-4e28-9ad4-2b59fb0aebeb req-c44cf6de-38ae-46ca-89bd-62ce68e86996 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-87bbca02-274d-4e28-9ad4-2b59fb0aebeb req-c44cf6de-38ae-46ca-89bd-62ce68e86996 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:32 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-87bbca02-274d-4e28-9ad4-2b59fb0aebeb req-c44cf6de-38ae-46ca-89bd-62ce68e86996 service nova] Creating event network-vif-plugged:66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c on user Apr 14 18:53:32 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-87bbca02-274d-4e28-9ad4-2b59fb0aebeb req-c44cf6de-38ae-46ca-89bd-62ce68e86996 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045922 Apr 14 18:53:32 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 156/468] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:53:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:32 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-6cf402cf-02f9-47e4-a11d-a7193a1a58e2 req-a771a29a-87d6-44bb-84e9-c9749db62964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e55c721-9fad-4478-9e74-e87d0c95bc3c", "name": "network-vif-deleted", "tag": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:53:32 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6cf402cf-02f9-47e4-a11d-a7193a1a58e2 req-a771a29a-87d6-44bb-84e9-c9749db62964 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:32 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6cf402cf-02f9-47e4-a11d-a7193a1a58e2 req-a771a29a-87d6-44bb-84e9-c9749db62964 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:32 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6cf402cf-02f9-47e4-a11d-a7193a1a58e2 req-a771a29a-87d6-44bb-84e9-c9749db62964 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:32 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-6cf402cf-02f9-47e4-a11d-a7193a1a58e2 req-a771a29a-87d6-44bb-84e9-c9749db62964 service nova] Creating event network-vif-deleted:66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c on user Apr 14 18:53:32 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-6cf402cf-02f9-47e4-a11d-a7193a1a58e2 req-a771a29a-87d6-44bb-84e9-c9749db62964 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046766 Apr 14 18:53:32 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 159/469] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:53:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:33 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1765673248", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "networks": [{"uuid": "7c02047b-1b40-4937-ac05-13accc969b21"}]}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:53:33 user devstack@n-api.service[61673]: DEBUG nova.network.neutron [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] validate_networks() for [('7c02047b-1b40-4937-ac05-13accc969b21', None, None, None, None, None)] {{(pid=61673) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:53:33 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-9b3216ea-df0a-4ddb-b099-b7d9633e5ba9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:33 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-9b3216ea-df0a-4ddb-b099-b7d9633e5ba9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:33 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9b3216ea-df0a-4ddb-b099-b7d9633e5ba9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:33 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9b3216ea-df0a-4ddb-b099-b7d9633e5ba9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:33 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9b3216ea-df0a-4ddb-b099-b7d9633e5ba9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:33 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9b3216ea-df0a-4ddb-b099-b7d9633e5ba9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:33 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9b3216ea-df0a-4ddb-b099-b7d9633e5ba9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:33 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9b3216ea-df0a-4ddb-b099-b7d9633e5ba9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:33 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Flavor limits 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:53:33 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Image limits 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:53:33 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Flavor pref 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:53:33 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Image pref 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:53:33 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:53:33 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:33 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:33 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:33 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:33 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:33 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:33 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Getting quotas for project 4af68184e7654efea3187e05bb10e5e4. Resources: {'ram', 'instances', 'cores'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:53:33 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Getting quotas for user 008a24026e844252b0be1268461bc2b1 and project 4af68184e7654efea3187e05bb10e5e4. Resources: {'ram', 'instances', 'cores'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:53:33 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Going to run 1 instances... {{(pid=61673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:53:33 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:53:33 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-9b3216ea-df0a-4ddb-b099-b7d9633e5ba9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:53:33 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:33 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-9b3216ea-df0a-4ddb-b099-b7d9633e5ba9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:53:33 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-9b3216ea-df0a-4ddb-b099-b7d9633e5ba9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:53:33 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:33 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-9b3216ea-df0a-4ddb-b099-b7d9633e5ba9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23d14a51-41aa-4827-bd60-c605d9689bc8" status: 200 len: 1768 microversion: 2.87 time: 0.309251 Apr 14 18:53:33 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 157/470] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:53:33 2023] GET /compute/v2.1/servers/23d14a51-41aa-4827-bd60-c605d9689bc8 => generated 1768 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:53:33 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.862446 Apr 14 18:53:33 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 155/471] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:53:33 2023] POST /compute/v2.1/servers => generated 378 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:53:34 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-281115d0-8650-498b-af5d-8031d41ac653 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:34 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-281115d0-8650-498b-af5d-8031d41ac653 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:34 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-281115d0-8650-498b-af5d-8031d41ac653 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008a24026e844252b0be1268461bc2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af68184e7654efea3187e05bb10e5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:53:34 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-281115d0-8650-498b-af5d-8031d41ac653 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97aafe40-5587-41cf-ba75-6077d9daa7eb" status: 200 len: 1211 microversion: 2.1 time: 0.102931 Apr 14 18:53:34 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 160/472] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:53:33 2023] GET /compute/v2.1/servers/97aafe40-5587-41cf-ba75-6077d9daa7eb => generated 1211 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:53:34 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-332b2e82-8e45-455b-8a37-f8f1d0a520f8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:53:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-332b2e82-8e45-455b-8a37-f8f1d0a520f8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-332b2e82-8e45-455b-8a37-f8f1d0a520f8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-332b2e82-8e45-455b-8a37-f8f1d0a520f8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:34 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-332b2e82-8e45-455b-8a37-f8f1d0a520f8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Going to try to stop instance {{(pid=61675) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 14 18:53:34 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-332b2e82-8e45-455b-8a37-f8f1d0a520f8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/action" status: 202 len: 0 microversion: 2.1 time: 0.139679 Apr 14 18:53:34 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 158/473] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 18:53:34 2023] POST /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:53:34 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-f618f8fb-564b-45c2-ad77-b00f22588e89 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:34 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-f618f8fb-564b-45c2-ad77-b00f22588e89 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f618f8fb-564b-45c2-ad77-b00f22588e89 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f618f8fb-564b-45c2-ad77-b00f22588e89 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f618f8fb-564b-45c2-ad77-b00f22588e89 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f618f8fb-564b-45c2-ad77-b00f22588e89 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f618f8fb-564b-45c2-ad77-b00f22588e89 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f618f8fb-564b-45c2-ad77-b00f22588e89 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:34 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-79056534-4418-465a-8f60-2156e59fe11f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:34 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-79056534-4418-465a-8f60-2156e59fe11f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-79056534-4418-465a-8f60-2156e59fe11f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-79056534-4418-465a-8f60-2156e59fe11f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-79056534-4418-465a-8f60-2156e59fe11f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-79056534-4418-465a-8f60-2156e59fe11f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-79056534-4418-465a-8f60-2156e59fe11f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-79056534-4418-465a-8f60-2156e59fe11f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:35 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-f618f8fb-564b-45c2-ad77-b00f22588e89 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f90c8f23e3b42a98fdb9261db65f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf25bcc0dea4d3eb1284e8995eb3466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:53:35 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-f618f8fb-564b-45c2-ad77-b00f22588e89 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4" status: 200 len: 1712 microversion: 2.1 time: 0.496969 Apr 14 18:53:35 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 156/474] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:53:34 2023] GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4 => generated 1712 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:53:35 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-fc347a61-fcfc-465a-8225-9277c6468349 req-ade72248-c12d-42f8-b66e-0bf61e0848af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0050e6bb-0b53-4fdc-8437-16b94ee79fa4", "name": "network-vif-unplugged", "status": "completed", "tag": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:53:35 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-fc347a61-fcfc-465a-8225-9277c6468349 req-ade72248-c12d-42f8-b66e-0bf61e0848af service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:35 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-fc347a61-fcfc-465a-8225-9277c6468349 req-ade72248-c12d-42f8-b66e-0bf61e0848af service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:35 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-fc347a61-fcfc-465a-8225-9277c6468349 req-ade72248-c12d-42f8-b66e-0bf61e0848af service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:35 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-fc347a61-fcfc-465a-8225-9277c6468349 req-ade72248-c12d-42f8-b66e-0bf61e0848af service nova] Creating event network-vif-unplugged:2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 on user Apr 14 18:53:35 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-fc347a61-fcfc-465a-8225-9277c6468349 req-ade72248-c12d-42f8-b66e-0bf61e0848af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039214 Apr 14 18:53:35 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 159/475] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:53:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:35 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-79056534-4418-465a-8f60-2156e59fe11f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d53edaffb8f4038abd366d7942c6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34cdebcd7154988a957deae140e8eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:53:35 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-79056534-4418-465a-8f60-2156e59fe11f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38" status: 200 len: 1543 microversion: 2.1 time: 0.353196 Apr 14 18:53:35 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 161/476] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:53:34 2023] GET /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38 => generated 1543 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:53:37 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-0cd8a48e-1889-4c92-9f4d-1e5f1ca9ae60 req-10590354-a0f8-43b2-8966-feeaddc1a7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0050e6bb-0b53-4fdc-8437-16b94ee79fa4", "name": "network-vif-plugged", "status": "completed", "tag": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:53:37 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-0cd8a48e-1889-4c92-9f4d-1e5f1ca9ae60 req-10590354-a0f8-43b2-8966-feeaddc1a7d0 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-0cd8a48e-1889-4c92-9f4d-1e5f1ca9ae60 req-10590354-a0f8-43b2-8966-feeaddc1a7d0 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-0cd8a48e-1889-4c92-9f4d-1e5f1ca9ae60 req-10590354-a0f8-43b2-8966-feeaddc1a7d0 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:37 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:37 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-0cd8a48e-1889-4c92-9f4d-1e5f1ca9ae60 req-10590354-a0f8-43b2-8966-feeaddc1a7d0 service nova] Creating event network-vif-plugged:2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 on user Apr 14 18:53:37 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-0cd8a48e-1889-4c92-9f4d-1e5f1ca9ae60 req-10590354-a0f8-43b2-8966-feeaddc1a7d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047074 Apr 14 18:53:37 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 157/477] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:53:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:37 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-6108e273-931d-4c61-9756-8de647b2e8bc req-4d8170cd-9671-4ab3-9412-29320ff0567b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97aafe40-5587-41cf-ba75-6077d9daa7eb", "tag": "00a6b78f-1816-4b0f-956b-3dc23b029449"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:53:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-6108e273-931d-4c61-9756-8de647b2e8bc req-4d8170cd-9671-4ab3-9412-29320ff0567b service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-6108e273-931d-4c61-9756-8de647b2e8bc req-4d8170cd-9671-4ab3-9412-29320ff0567b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-6108e273-931d-4c61-9756-8de647b2e8bc req-4d8170cd-9671-4ab3-9412-29320ff0567b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:37 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-6108e273-931d-4c61-9756-8de647b2e8bc req-4d8170cd-9671-4ab3-9412-29320ff0567b service nova] Creating event network-changed:00a6b78f-1816-4b0f-956b-3dc23b029449 for instance 97aafe40-5587-41cf-ba75-6077d9daa7eb on user Apr 14 18:53:37 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-6108e273-931d-4c61-9756-8de647b2e8bc req-4d8170cd-9671-4ab3-9412-29320ff0567b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066551 Apr 14 18:53:37 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 160/478] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:53:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:38 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-6e09849f-09ce-4527-a53b-cdc65aae0384 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:38 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-6e09849f-09ce-4527-a53b-cdc65aae0384 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:38 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:38 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6e09849f-09ce-4527-a53b-cdc65aae0384 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:38 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6e09849f-09ce-4527-a53b-cdc65aae0384 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:38 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6e09849f-09ce-4527-a53b-cdc65aae0384 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:38 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6e09849f-09ce-4527-a53b-cdc65aae0384 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:38 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6e09849f-09ce-4527-a53b-cdc65aae0384 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:38 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6e09849f-09ce-4527-a53b-cdc65aae0384 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:38 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:38 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-6e09849f-09ce-4527-a53b-cdc65aae0384 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e3f2dda9bc49f48c66beb978dbdaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0091007734312b8d33caf294d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:53:38 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-6e09849f-09ce-4527-a53b-cdc65aae0384 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2a860bd-802f-4760-b77b-92b7ac4ad09b" status: 200 len: 1433 microversion: 2.1 time: 0.312772 Apr 14 18:53:38 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 162/479] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:53:38 2023] GET /compute/v2.1/servers/a2a860bd-802f-4760-b77b-92b7ac4ad09b => generated 1433 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:53:40 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-b835cc4f-73d5-483c-9285-c1e68be945e8 req-76e9ff6e-f2ea-4616-966c-8c786fc84fbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97aafe40-5587-41cf-ba75-6077d9daa7eb", "name": "network-vif-plugged", "status": "completed", "tag": "00a6b78f-1816-4b0f-956b-3dc23b029449"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:53:40 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-b835cc4f-73d5-483c-9285-c1e68be945e8 req-76e9ff6e-f2ea-4616-966c-8c786fc84fbd service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:40 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-b835cc4f-73d5-483c-9285-c1e68be945e8 req-76e9ff6e-f2ea-4616-966c-8c786fc84fbd service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:40 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-b835cc4f-73d5-483c-9285-c1e68be945e8 req-76e9ff6e-f2ea-4616-966c-8c786fc84fbd service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:40 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-b835cc4f-73d5-483c-9285-c1e68be945e8 req-76e9ff6e-f2ea-4616-966c-8c786fc84fbd service nova] Creating event network-vif-plugged:00a6b78f-1816-4b0f-956b-3dc23b029449 for instance 97aafe40-5587-41cf-ba75-6077d9daa7eb on user Apr 14 18:53:40 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-b835cc4f-73d5-483c-9285-c1e68be945e8 req-76e9ff6e-f2ea-4616-966c-8c786fc84fbd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050185 Apr 14 18:53:40 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 158/480] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:53:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:41 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-e94cb708-a63a-4b5c-87e0-4083fd0aa89d req-ba2160c7-88eb-4dd2-ae4e-34bf8946c93e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a860bd-802f-4760-b77b-92b7ac4ad09b", "tag": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:53:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-e94cb708-a63a-4b5c-87e0-4083fd0aa89d req-ba2160c7-88eb-4dd2-ae4e-34bf8946c93e service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-e94cb708-a63a-4b5c-87e0-4083fd0aa89d req-ba2160c7-88eb-4dd2-ae4e-34bf8946c93e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-e94cb708-a63a-4b5c-87e0-4083fd0aa89d req-ba2160c7-88eb-4dd2-ae4e-34bf8946c93e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:41 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-e94cb708-a63a-4b5c-87e0-4083fd0aa89d req-ba2160c7-88eb-4dd2-ae4e-34bf8946c93e service nova] Creating event network-changed:ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 for instance a2a860bd-802f-4760-b77b-92b7ac4ad09b on user Apr 14 18:53:41 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-e94cb708-a63a-4b5c-87e0-4083fd0aa89d req-ba2160c7-88eb-4dd2-ae4e-34bf8946c93e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063415 Apr 14 18:53:41 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 161/481] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:53:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:41 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:53:41 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:41 user devstack@n-api.service[61674]: DEBUG nova.objects.instance [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lazy-loading 'flavor' on Instance uuid a2a860bd-802f-4760-b77b-92b7ac4ad09b {{(pid=61674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 18:53:41 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a2a860bd-802f-4760-b77b-92b7ac4ad09b/action" status: 202 len: 0 microversion: 2.1 time: 0.135944 Apr 14 18:53:41 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 163/482] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 18:53:41 2023] POST /compute/v2.1/servers/a2a860bd-802f-4760-b77b-92b7ac4ad09b/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:53:41 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-1d409656-cfab-44f2-906b-8f336735b7b9 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:41 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-1d409656-cfab-44f2-906b-8f336735b7b9 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1d409656-cfab-44f2-906b-8f336735b7b9 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1d409656-cfab-44f2-906b-8f336735b7b9 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1d409656-cfab-44f2-906b-8f336735b7b9 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1d409656-cfab-44f2-906b-8f336735b7b9 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1d409656-cfab-44f2-906b-8f336735b7b9 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1d409656-cfab-44f2-906b-8f336735b7b9 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:41 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-1d409656-cfab-44f2-906b-8f336735b7b9 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e3f2dda9bc49f48c66beb978dbdaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0091007734312b8d33caf294d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:53:41 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-1d409656-cfab-44f2-906b-8f336735b7b9 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2a860bd-802f-4760-b77b-92b7ac4ad09b" status: 200 len: 1439 microversion: 2.1 time: 0.377934 Apr 14 18:53:41 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 159/483] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:53:41 2023] GET /compute/v2.1/servers/a2a860bd-802f-4760-b77b-92b7ac4ad09b => generated 1439 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:53:42 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-7322c960-0442-40ba-b1d8-09b364a53a05 req-d8d31b15-8159-4721-a4ab-3587e62d8439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97aafe40-5587-41cf-ba75-6077d9daa7eb", "name": "network-vif-plugged", "status": "completed", "tag": "00a6b78f-1816-4b0f-956b-3dc23b029449"}, {"server_uuid": "a2a860bd-802f-4760-b77b-92b7ac4ad09b", "name": "network-vif-unplugged", "status": "completed", "tag": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293"}, {"server_uuid": "a2a860bd-802f-4760-b77b-92b7ac4ad09b", "name": "network-vif-plugged", "status": "completed", "tag": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:53:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-7322c960-0442-40ba-b1d8-09b364a53a05 req-d8d31b15-8159-4721-a4ab-3587e62d8439 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-7322c960-0442-40ba-b1d8-09b364a53a05 req-d8d31b15-8159-4721-a4ab-3587e62d8439 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-7322c960-0442-40ba-b1d8-09b364a53a05 req-d8d31b15-8159-4721-a4ab-3587e62d8439 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:42 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-7322c960-0442-40ba-b1d8-09b364a53a05 req-d8d31b15-8159-4721-a4ab-3587e62d8439 service nova] Creating event network-vif-plugged:00a6b78f-1816-4b0f-956b-3dc23b029449 for instance 97aafe40-5587-41cf-ba75-6077d9daa7eb on user Apr 14 18:53:42 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-7322c960-0442-40ba-b1d8-09b364a53a05 req-d8d31b15-8159-4721-a4ab-3587e62d8439 service nova] Creating event network-vif-unplugged:ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 for instance a2a860bd-802f-4760-b77b-92b7ac4ad09b on user Apr 14 18:53:42 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-7322c960-0442-40ba-b1d8-09b364a53a05 req-d8d31b15-8159-4721-a4ab-3587e62d8439 service nova] Creating event network-vif-plugged:ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 for instance a2a860bd-802f-4760-b77b-92b7ac4ad09b on user Apr 14 18:53:42 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-7322c960-0442-40ba-b1d8-09b364a53a05 req-d8d31b15-8159-4721-a4ab-3587e62d8439 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.050128 Apr 14 18:53:42 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 162/484] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:53:42 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:43 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-a3d1d6d6-2c56-4ea6-87ea-ecbb3f3f9b11 req-f4c65135-1970-499b-8a42-bd291751eb1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a860bd-802f-4760-b77b-92b7ac4ad09b", "tag": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:53:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-a3d1d6d6-2c56-4ea6-87ea-ecbb3f3f9b11 req-f4c65135-1970-499b-8a42-bd291751eb1d service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-a3d1d6d6-2c56-4ea6-87ea-ecbb3f3f9b11 req-f4c65135-1970-499b-8a42-bd291751eb1d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-a3d1d6d6-2c56-4ea6-87ea-ecbb3f3f9b11 req-f4c65135-1970-499b-8a42-bd291751eb1d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:43 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-a3d1d6d6-2c56-4ea6-87ea-ecbb3f3f9b11 req-f4c65135-1970-499b-8a42-bd291751eb1d service nova] Creating event network-changed:ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 for instance a2a860bd-802f-4760-b77b-92b7ac4ad09b on user Apr 14 18:53:43 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-a3d1d6d6-2c56-4ea6-87ea-ecbb3f3f9b11 req-f4c65135-1970-499b-8a42-bd291751eb1d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038012 Apr 14 18:53:43 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 164/485] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:53:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:48 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:48 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=6 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:48 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-bd189973-154b-4672-b132-9caaa7f61589 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Action: 'create', calling method: .version_select at 0x7fdae10a2170>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1291959456"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:53:48 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-bd189973-154b-4672-b132-9caaa7f61589 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.468003 Apr 14 18:53:48 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 160/486] 10.0.0.210 () {64 vars in 1232 bytes} [Fri Apr 14 18:53:48 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 469 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 14 18:53:48 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-1561aa71-0506-44ca-a160-264bcb1df039 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Calling method '.version_select at 0x7fdae11efbe0>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:48 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-1561aa71-0506-44ca-a160-264bcb1df039 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3719ce71-1859-4749-86eb-0a84bffaeb48" status: 200 len: 345 microversion: 2.1 time: 0.048222 Apr 14 18:53:48 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 163/487] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 18:53:48 2023] GET /compute/v2.1/os-volumes/3719ce71-1859-4749-86eb-0a84bffaeb48 => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:49 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-a57fd474-e50e-4d87-9069-b25848582194 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Calling method '.version_select at 0x7fdae1176830>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:49 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:49 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-a57fd474-e50e-4d87-9069-b25848582194 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3719ce71-1859-4749-86eb-0a84bffaeb48" status: 200 len: 345 microversion: 2.1 time: 0.071454 Apr 14 18:53:49 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 165/488] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 18:53:49 2023] GET /compute/v2.1/os-volumes/3719ce71-1859-4749-86eb-0a84bffaeb48 => generated 345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:50 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-4153075c-8dbc-4bc7-a50b-2fdd2ec3395b tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Calling method '.version_select at 0x7fdae10a00d0>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:50 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-4153075c-8dbc-4bc7-a50b-2fdd2ec3395b tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3719ce71-1859-4749-86eb-0a84bffaeb48" status: 200 len: 346 microversion: 2.1 time: 0.048604 Apr 14 18:53:50 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 161/489] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 18:53:50 2023] GET /compute/v2.1/os-volumes/3719ce71-1859-4749-86eb-0a84bffaeb48 => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:51 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-794ecbc1-669d-4ee0-a1ef-aed3ee383faa tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Action: 'create', calling method: .version_select at 0x7fdae103b640>, body: {"snapshot": {"volume_id": "3719ce71-1859-4749-86eb-0a84bffaeb48", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-83753205"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:53:51 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-794ecbc1-669d-4ee0-a1ef-aed3ee383faa tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.166973 Apr 14 18:53:51 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 164/490] 10.0.0.210 () {64 vars in 1239 bytes} [Fri Apr 14 18:53:51 2023] POST /compute/v2.1/os-snapshots => generated 285 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:51 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-2a75ed78-7510-42c2-b5bc-4f18a163bc95 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Calling method '.version_select at 0x7fdae1062e60>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:51 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-2a75ed78-7510-42c2-b5bc-4f18a163bc95 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/0c3c88da-e2f8-4269-8b3f-a78995c5c78e" status: 200 len: 285 microversion: 2.1 time: 0.044997 Apr 14 18:53:51 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 166/491] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 18:53:51 2023] GET /compute/v2.1/os-snapshots/0c3c88da-e2f8-4269-8b3f-a78995c5c78e => generated 285 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:51 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-2bdf4e8d-056e-4e18-bda8-a0ced37998ee tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Calling method '.version_select at 0x7fdae1037f40>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:51 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-2bdf4e8d-056e-4e18-bda8-a0ced37998ee tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.038987 Apr 14 18:53:51 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 162/492] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 14 18:53:51 2023] GET /compute/v2.1/os-snapshots => generated 288 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:51 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-316b5bcc-c79f-42d7-8216-597cf3acaa11 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Calling method '.version_select at 0x7fdae11ee0e0>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:51 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-316b5bcc-c79f-42d7-8216-597cf3acaa11 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/0c3c88da-e2f8-4269-8b3f-a78995c5c78e" status: 200 len: 285 microversion: 2.1 time: 0.032496 Apr 14 18:53:51 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 165/493] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 18:53:51 2023] GET /compute/v2.1/os-snapshots/0c3c88da-e2f8-4269-8b3f-a78995c5c78e => generated 285 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 18:53:52 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-5bcd0e99-8913-4e48-b180-ee786ff61dc8 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Calling method '.version_select at 0x7fdae10228c0>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:52 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-5bcd0e99-8913-4e48-b180-ee786ff61dc8 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/0c3c88da-e2f8-4269-8b3f-a78995c5c78e" status: 200 len: 285 microversion: 2.1 time: 0.035589 Apr 14 18:53:52 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 167/494] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 18:53:52 2023] GET /compute/v2.1/os-snapshots/0c3c88da-e2f8-4269-8b3f-a78995c5c78e => generated 285 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:53 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=5 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:53 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=9 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:53 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-47825e6a-7aa2-4c6f-9936-07287e9da749 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Calling method '.version_select at 0x7fdae10a1ea0>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:53 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-47825e6a-7aa2-4c6f-9936-07287e9da749 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/0c3c88da-e2f8-4269-8b3f-a78995c5c78e" status: 200 len: 285 microversion: 2.1 time: 0.042163 Apr 14 18:53:53 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 163/495] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 18:53:53 2023] GET /compute/v2.1/os-snapshots/0c3c88da-e2f8-4269-8b3f-a78995c5c78e => generated 285 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 18:53:54 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-17b33ef5-21a2-461c-b3af-f28ae0d1dc64 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Calling method '.version_select at 0x7fdae1039900>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:54 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=11 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:54 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:54 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-17b33ef5-21a2-461c-b3af-f28ae0d1dc64 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/0c3c88da-e2f8-4269-8b3f-a78995c5c78e" status: 200 len: 286 microversion: 2.1 time: 0.038879 Apr 14 18:53:54 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 166/496] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 18:53:54 2023] GET /compute/v2.1/os-snapshots/0c3c88da-e2f8-4269-8b3f-a78995c5c78e => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:54 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-a65680eb-8b5b-4fc3-b6c7-43dc088ac248 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Calling method '.version_select at 0x7fdae10604c0>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:54 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=5 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:54 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:53:54 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-a65680eb-8b5b-4fc3-b6c7-43dc088ac248 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/0c3c88da-e2f8-4269-8b3f-a78995c5c78e" status: 202 len: 0 microversion: 2.1 time: 0.065488 Apr 14 18:53:54 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 168/497] 10.0.0.210 () {62 vars in 1331 bytes} [Fri Apr 14 18:53:54 2023] DELETE /compute/v2.1/os-snapshots/0c3c88da-e2f8-4269-8b3f-a78995c5c78e => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:53:54 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-7174a9dd-99be-495d-a1e8-07a03992afd5 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Calling method '.version_select at 0x7fdae10377f0>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:54 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-7174a9dd-99be-495d-a1e8-07a03992afd5 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/0c3c88da-e2f8-4269-8b3f-a78995c5c78e" status: 200 len: 285 microversion: 2.1 time: 0.036331 Apr 14 18:53:54 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 164/498] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 18:53:54 2023] GET /compute/v2.1/os-snapshots/0c3c88da-e2f8-4269-8b3f-a78995c5c78e => generated 285 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:55 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-097814dd-03d4-4dfe-9876-6d660c0825de tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Calling method '.version_select at 0x7fdae11efd00>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:55 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-097814dd-03d4-4dfe-9876-6d660c0825de tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/0c3c88da-e2f8-4269-8b3f-a78995c5c78e" status: 200 len: 285 microversion: 2.1 time: 0.035993 Apr 14 18:53:55 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 167/499] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 18:53:55 2023] GET /compute/v2.1/os-snapshots/0c3c88da-e2f8-4269-8b3f-a78995c5c78e => generated 285 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:56 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-34eecf6d-58f5-4cfb-9d5a-ee2e159cb05a tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Calling method '.version_select at 0x7fdae1020a60>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:56 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-34eecf6d-58f5-4cfb-9d5a-ee2e159cb05a tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/0c3c88da-e2f8-4269-8b3f-a78995c5c78e" status: 200 len: 285 microversion: 2.1 time: 0.033367 Apr 14 18:53:56 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 169/500] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 18:53:56 2023] GET /compute/v2.1/os-snapshots/0c3c88da-e2f8-4269-8b3f-a78995c5c78e => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:57 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-9faf710f-d708-4ca4-a86c-85e6b788edbc tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Calling method '.version_select at 0x7fdae10a1900>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:57 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-9faf710f-d708-4ca4-a86c-85e6b788edbc tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] HTTP exception thrown: Snapshot 0c3c88da-e2f8-4269-8b3f-a78995c5c78e could not be found. Apr 14 18:53:57 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-9faf710f-d708-4ca4-a86c-85e6b788edbc tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Request method failure captured: Apr 14 18:53:57 user devstack@n-api.service[61673]: request: GET /compute/v2.1/os-snapshots/0c3c88da-e2f8-4269-8b3f-a78995c5c78e HTTP/1.1 Apr 14 18:53:57 user devstack@n-api.service[61673]: Accept: application/json Apr 14 18:53:57 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 18:53:57 user devstack@n-api.service[61673]: Connection: close Apr 14 18:53:57 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 18:53:57 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 18:53:57 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 18:53:57 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 18:53:57 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 18:53:57 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOaE8QdjtyvZQO6zvhGYql9ckzQom7oc469JH6qLPRSMXblj7ysc1U8qFbkMYSVWP7otih2UwCm7iyswyjiPtBGw_D4nimquJnqGtZchdBgwxr0NzM8n57BobSV0tSmrVsx0ER0uFF7hO8zu218DgTt-DJPkCvILdKDKVrtkH5Jmr61c Apr 14 18:53:57 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 18:53:57 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 18:53:57 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 18:53:57 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 18:53:57 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 18:53:57 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 18:53:57 user devstack@n-api.service[61673]: X-Project-Id: b4f0ac9ddf6648b79653e4cbf5cec954 Apr 14 18:53:57 user devstack@n-api.service[61673]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-655505838 Apr 14 18:53:57 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 18:53:57 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 18:53:57 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4f0ac9ddf6648b79653e4cbf5cec954"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b4f0ac9ddf6648b79653e4cbf5cec954"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4f0ac9ddf6648b79653e4cbf5cec954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:53:57 user devstack@n-api.service[61673]: X-Tenant: tempest-VolumesSnapshotsTestJSON-655505838 Apr 14 18:53:57 user devstack@n-api.service[61673]: X-Tenant-Id: b4f0ac9ddf6648b79653e4cbf5cec954 Apr 14 18:53:57 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-655505838 Apr 14 18:53:57 user devstack@n-api.service[61673]: X-User: tempest-VolumesSnapshotsTestJSON-655505838-project-member Apr 14 18:53:57 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 18:53:57 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 18:53:57 user devstack@n-api.service[61673]: X-User-Id: 2d6aa5b433984449af07c666bc441539 Apr 14 18:53:57 user devstack@n-api.service[61673]: X-User-Name: tempest-VolumesSnapshotsTestJSON-655505838-project-member Apr 14 18:53:57 user devstack@n-api.service[61673]: method: Apr 14 18:53:57 user devstack@n-api.service[61673]: exception: Snapshot 0c3c88da-e2f8-4269-8b3f-a78995c5c78e could not be found. Apr 14 18:53:57 user devstack@n-api.service[61673]: action_args: {'id': '0c3c88da-e2f8-4269-8b3f-a78995c5c78e'} Apr 14 18:53:57 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0c3c88da-e2f8-4269-8b3f-a78995c5c78e could not be found. (HTTP 404) (Request-ID: req-116237fb-9758-454f-83ee-28bf241c5c7d) Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0c3c88da-e2f8-4269-8b3f-a78995c5c78e could not be found. Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0c3c88da-e2f8-4269-8b3f-a78995c5c78e could not be found. Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0c3c88da-e2f8-4269-8b3f-a78995c5c78e could not be found. Apr 14 18:53:57 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:53:57 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-9faf710f-d708-4ca4-a86c-85e6b788edbc tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Returning 404 to user: Snapshot 0c3c88da-e2f8-4269-8b3f-a78995c5c78e could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:53:57 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-9faf710f-d708-4ca4-a86c-85e6b788edbc tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/0c3c88da-e2f8-4269-8b3f-a78995c5c78e" status: 404 len: 111 microversion: 2.1 time: 0.039622 Apr 14 18:53:57 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 165/501] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 18:53:57 2023] GET /compute/v2.1/os-snapshots/0c3c88da-e2f8-4269-8b3f-a78995c5c78e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:53:57 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-f5a6624d-1727-450f-b155-c290fa7b39f2 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Calling method '.version_select at 0x7fdae1038310>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:57 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-f5a6624d-1727-450f-b155-c290fa7b39f2 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/3719ce71-1859-4749-86eb-0a84bffaeb48" status: 202 len: 0 microversion: 2.1 time: 0.063783 Apr 14 18:53:57 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 168/502] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 18:53:57 2023] DELETE /compute/v2.1/os-volumes/3719ce71-1859-4749-86eb-0a84bffaeb48 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:53:57 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-1fc0cbe2-1746-4457-832f-711d0915095f tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Calling method '.version_select at 0x7fdae10624d0>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:57 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-1fc0cbe2-1746-4457-832f-711d0915095f tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3719ce71-1859-4749-86eb-0a84bffaeb48" status: 200 len: 345 microversion: 2.1 time: 0.059552 Apr 14 18:53:57 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 170/503] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 18:53:57 2023] GET /compute/v2.1/os-volumes/3719ce71-1859-4749-86eb-0a84bffaeb48 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:58 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-77b11879-142b-4c89-ab42-c2392ccfd338 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:58 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-77b11879-142b-4c89-ab42-c2392ccfd338 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:53:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-77b11879-142b-4c89-ab42-c2392ccfd338 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-77b11879-142b-4c89-ab42-c2392ccfd338 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-77b11879-142b-4c89-ab42-c2392ccfd338 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-77b11879-142b-4c89-ab42-c2392ccfd338 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:53:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-77b11879-142b-4c89-ab42-c2392ccfd338 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:53:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-77b11879-142b-4c89-ab42-c2392ccfd338 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:53:58 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-77b11879-142b-4c89-ab42-c2392ccfd338 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] HTTP exception thrown: Instance 1285eca2-575b-4550-a424-605fb186b510 could not be found. Apr 14 18:53:58 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-77b11879-142b-4c89-ab42-c2392ccfd338 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Request method failure captured: Apr 14 18:53:58 user devstack@n-api.service[61673]: request: GET /compute/v2.1/servers/1285eca2-575b-4550-a424-605fb186b510 HTTP/1.1 Apr 14 18:53:58 user devstack@n-api.service[61673]: Accept: application/json Apr 14 18:53:58 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 18:53:58 user devstack@n-api.service[61673]: Connection: close Apr 14 18:53:58 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 18:53:58 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 18:53:58 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 18:53:58 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 18:53:58 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 18:53:58 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOZ-qH7pUgx1LyHp_evZQKZ_odKsayVUEioA7FsUb5qz5KOEXA8Q45h-O1RAk3XTjiaMAMWpEO8wz64sI5645XRskJbMTOS1Ctww3740pnmC0HZo87gVqSukUBxDnTKy45LghZkZjn_nmbep2etza8DblI_GcbcARzkVfiuA-13jLfHg Apr 14 18:53:58 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 18:53:58 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 18:53:58 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 18:53:58 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 18:53:58 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 18:53:58 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 18:53:58 user devstack@n-api.service[61673]: X-Project-Id: 95319509fb6a4e58998703975370877a Apr 14 18:53:58 user devstack@n-api.service[61673]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1033700636 Apr 14 18:53:58 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 18:53:58 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 18:53:58 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/95319509fb6a4e58998703975370877a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/95319509fb6a4e58998703975370877a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/95319509fb6a4e58998703975370877a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:53:58 user devstack@n-api.service[61673]: X-Tenant: tempest-VolumesSnapshotTestJSON-1033700636 Apr 14 18:53:58 user devstack@n-api.service[61673]: X-Tenant-Id: 95319509fb6a4e58998703975370877a Apr 14 18:53:58 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1033700636 Apr 14 18:53:58 user devstack@n-api.service[61673]: X-User: tempest-VolumesSnapshotTestJSON-1033700636-project-member Apr 14 18:53:58 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 18:53:58 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 18:53:58 user devstack@n-api.service[61673]: X-User-Id: 1f3f788e144c46e7bdf6f4fe3a5aeb79 Apr 14 18:53:58 user devstack@n-api.service[61673]: X-User-Name: tempest-VolumesSnapshotTestJSON-1033700636-project-member Apr 14 18:53:58 user devstack@n-api.service[61673]: method: > Apr 14 18:53:58 user devstack@n-api.service[61673]: exception: Instance 1285eca2-575b-4550-a424-605fb186b510 could not be found. Apr 14 18:53:58 user devstack@n-api.service[61673]: action_args: {'id': '1285eca2-575b-4550-a424-605fb186b510'} Apr 14 18:53:58 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1285eca2-575b-4550-a424-605fb186b510 could not be found. Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1285eca2-575b-4550-a424-605fb186b510 could not be found. Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1285eca2-575b-4550-a424-605fb186b510 could not be found. Apr 14 18:53:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:53:58 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-77b11879-142b-4c89-ab42-c2392ccfd338 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Returning 404 to user: Instance 1285eca2-575b-4550-a424-605fb186b510 could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:53:58 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-77b11879-142b-4c89-ab42-c2392ccfd338 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1285eca2-575b-4550-a424-605fb186b510" status: 404 len: 111 microversion: 2.1 time: 0.030250 Apr 14 18:53:58 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 166/504] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:53:58 2023] GET /compute/v2.1/servers/1285eca2-575b-4550-a424-605fb186b510 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:53:58 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-960a001e-32c0-44cf-940f-1206a354bf11 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Calling method '.version_select at 0x7fdae11ef370>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:58 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-960a001e-32c0-44cf-940f-1206a354bf11 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3719ce71-1859-4749-86eb-0a84bffaeb48" status: 200 len: 345 microversion: 2.1 time: 0.052048 Apr 14 18:53:58 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 169/505] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 18:53:58 2023] GET /compute/v2.1/os-volumes/3719ce71-1859-4749-86eb-0a84bffaeb48 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:53:59 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-d9a27b83-51d0-4bfc-8f0f-cc8d82ae5698 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Calling method '.version_select at 0x7fdae10204c0>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:53:59 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-d9a27b83-51d0-4bfc-8f0f-cc8d82ae5698 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3719ce71-1859-4749-86eb-0a84bffaeb48" status: 200 len: 345 microversion: 2.1 time: 0.052947 Apr 14 18:53:59 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 171/506] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 18:53:59 2023] GET /compute/v2.1/os-volumes/3719ce71-1859-4749-86eb-0a84bffaeb48 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:54:00 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-2c4f7bd2-d18f-4153-9887-65ae8b4e8db4 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Calling method '.version_select at 0x7fdae10a0af0>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:54:01 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-2c4f7bd2-d18f-4153-9887-65ae8b4e8db4 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] HTTP exception thrown: Volume 3719ce71-1859-4749-86eb-0a84bffaeb48 could not be found. Apr 14 18:54:01 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-2c4f7bd2-d18f-4153-9887-65ae8b4e8db4 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Request method failure captured: Apr 14 18:54:01 user devstack@n-api.service[61673]: request: GET /compute/v2.1/os-volumes/3719ce71-1859-4749-86eb-0a84bffaeb48 HTTP/1.1 Apr 14 18:54:01 user devstack@n-api.service[61673]: Accept: application/json Apr 14 18:54:01 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 18:54:01 user devstack@n-api.service[61673]: Connection: close Apr 14 18:54:01 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 18:54:01 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 18:54:01 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 18:54:01 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 18:54:01 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 18:54:01 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOaE8QdjtyvZQO6zvhGYql9ckzQom7oc469JH6qLPRSMXblj7ysc1U8qFbkMYSVWP7otih2UwCm7iyswyjiPtBGw_D4nimquJnqGtZchdBgwxr0NzM8n57BobSV0tSmrVsx0ER0uFF7hO8zu218DgTt-DJPkCvILdKDKVrtkH5Jmr61c Apr 14 18:54:01 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 18:54:01 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 18:54:01 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 18:54:01 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 18:54:01 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 18:54:01 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 18:54:01 user devstack@n-api.service[61673]: X-Project-Id: b4f0ac9ddf6648b79653e4cbf5cec954 Apr 14 18:54:01 user devstack@n-api.service[61673]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-655505838 Apr 14 18:54:01 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 18:54:01 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 18:54:01 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4f0ac9ddf6648b79653e4cbf5cec954"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b4f0ac9ddf6648b79653e4cbf5cec954"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4f0ac9ddf6648b79653e4cbf5cec954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:54:01 user devstack@n-api.service[61673]: X-Tenant: tempest-VolumesSnapshotsTestJSON-655505838 Apr 14 18:54:01 user devstack@n-api.service[61673]: X-Tenant-Id: b4f0ac9ddf6648b79653e4cbf5cec954 Apr 14 18:54:01 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-655505838 Apr 14 18:54:01 user devstack@n-api.service[61673]: X-User: tempest-VolumesSnapshotsTestJSON-655505838-project-member Apr 14 18:54:01 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 18:54:01 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 18:54:01 user devstack@n-api.service[61673]: X-User-Id: 2d6aa5b433984449af07c666bc441539 Apr 14 18:54:01 user devstack@n-api.service[61673]: X-User-Name: tempest-VolumesSnapshotsTestJSON-655505838-project-member Apr 14 18:54:01 user devstack@n-api.service[61673]: method: Apr 14 18:54:01 user devstack@n-api.service[61673]: exception: Volume 3719ce71-1859-4749-86eb-0a84bffaeb48 could not be found. Apr 14 18:54:01 user devstack@n-api.service[61673]: action_args: {'id': '3719ce71-1859-4749-86eb-0a84bffaeb48'} Apr 14 18:54:01 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3719ce71-1859-4749-86eb-0a84bffaeb48 could not be found. (HTTP 404) (Request-ID: req-769aae2f-293d-414c-b23b-5cfae4848940) Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3719ce71-1859-4749-86eb-0a84bffaeb48 could not be found. Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3719ce71-1859-4749-86eb-0a84bffaeb48 could not be found. Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3719ce71-1859-4749-86eb-0a84bffaeb48 could not be found. Apr 14 18:54:01 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:54:01 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-2c4f7bd2-d18f-4153-9887-65ae8b4e8db4 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Returning 404 to user: Volume 3719ce71-1859-4749-86eb-0a84bffaeb48 could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:54:01 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-2c4f7bd2-d18f-4153-9887-65ae8b4e8db4 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3719ce71-1859-4749-86eb-0a84bffaeb48" status: 404 len: 109 microversion: 2.1 time: 0.043848 Apr 14 18:54:01 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 167/507] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 18:54:00 2023] GET /compute/v2.1/os-volumes/3719ce71-1859-4749-86eb-0a84bffaeb48 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:54:01 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-7af5e7e2-4d4d-4adb-8ad2-894827c9ac07 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Calling method '.version_select at 0x7fdae0f14160>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:54:01 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-7af5e7e2-4d4d-4adb-8ad2-894827c9ac07 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] HTTP exception thrown: Volume 3719ce71-1859-4749-86eb-0a84bffaeb48 could not be found. Apr 14 18:54:01 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-7af5e7e2-4d4d-4adb-8ad2-894827c9ac07 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Request method failure captured: Apr 14 18:54:01 user devstack@n-api.service[61675]: request: DELETE /compute/v2.1/os-volumes/3719ce71-1859-4749-86eb-0a84bffaeb48 HTTP/1.1 Apr 14 18:54:01 user devstack@n-api.service[61675]: Accept: application/json Apr 14 18:54:01 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 18:54:01 user devstack@n-api.service[61675]: Connection: close Apr 14 18:54:01 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 18:54:01 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 18:54:01 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 18:54:01 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 18:54:01 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 18:54:01 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOaE8QdjtyvZQO6zvhGYql9ckzQom7oc469JH6qLPRSMXblj7ysc1U8qFbkMYSVWP7otih2UwCm7iyswyjiPtBGw_D4nimquJnqGtZchdBgwxr0NzM8n57BobSV0tSmrVsx0ER0uFF7hO8zu218DgTt-DJPkCvILdKDKVrtkH5Jmr61c Apr 14 18:54:01 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 18:54:01 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 18:54:01 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 18:54:01 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 18:54:01 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 18:54:01 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 18:54:01 user devstack@n-api.service[61675]: X-Project-Id: b4f0ac9ddf6648b79653e4cbf5cec954 Apr 14 18:54:01 user devstack@n-api.service[61675]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-655505838 Apr 14 18:54:01 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 18:54:01 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 18:54:01 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4f0ac9ddf6648b79653e4cbf5cec954"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b4f0ac9ddf6648b79653e4cbf5cec954"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4f0ac9ddf6648b79653e4cbf5cec954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:54:01 user devstack@n-api.service[61675]: X-Tenant: tempest-VolumesSnapshotsTestJSON-655505838 Apr 14 18:54:01 user devstack@n-api.service[61675]: X-Tenant-Id: b4f0ac9ddf6648b79653e4cbf5cec954 Apr 14 18:54:01 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-655505838 Apr 14 18:54:01 user devstack@n-api.service[61675]: X-User: tempest-VolumesSnapshotsTestJSON-655505838-project-member Apr 14 18:54:01 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 18:54:01 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 18:54:01 user devstack@n-api.service[61675]: X-User-Id: 2d6aa5b433984449af07c666bc441539 Apr 14 18:54:01 user devstack@n-api.service[61675]: X-User-Name: tempest-VolumesSnapshotsTestJSON-655505838-project-member Apr 14 18:54:01 user devstack@n-api.service[61675]: method: Apr 14 18:54:01 user devstack@n-api.service[61675]: exception: Volume 3719ce71-1859-4749-86eb-0a84bffaeb48 could not be found. Apr 14 18:54:01 user devstack@n-api.service[61675]: action_args: {'id': '3719ce71-1859-4749-86eb-0a84bffaeb48'} Apr 14 18:54:01 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3719ce71-1859-4749-86eb-0a84bffaeb48 could not be found. (HTTP 404) (Request-ID: req-1db272f7-89c0-4373-a308-0ad2469b7211) Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3719ce71-1859-4749-86eb-0a84bffaeb48 could not be found. Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3719ce71-1859-4749-86eb-0a84bffaeb48 could not be found. Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3719ce71-1859-4749-86eb-0a84bffaeb48 could not be found. Apr 14 18:54:01 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:54:01 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-7af5e7e2-4d4d-4adb-8ad2-894827c9ac07 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Returning 404 to user: Volume 3719ce71-1859-4749-86eb-0a84bffaeb48 could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:54:01 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-7af5e7e2-4d4d-4adb-8ad2-894827c9ac07 tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/3719ce71-1859-4749-86eb-0a84bffaeb48" status: 404 len: 109 microversion: 2.1 time: 0.037452 Apr 14 18:54:01 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 170/508] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 18:54:01 2023] DELETE /compute/v2.1/os-volumes/3719ce71-1859-4749-86eb-0a84bffaeb48 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:54:01 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-ae3fda29-0bdf-489f-a84e-e6ede384870c tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Calling method '.version_select at 0x7fdae1062170>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:54:01 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-ae3fda29-0bdf-489f-a84e-e6ede384870c tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] HTTP exception thrown: Volume 3719ce71-1859-4749-86eb-0a84bffaeb48 could not be found. Apr 14 18:54:01 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-ae3fda29-0bdf-489f-a84e-e6ede384870c tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Request method failure captured: Apr 14 18:54:01 user devstack@n-api.service[61674]: request: GET /compute/v2.1/os-volumes/3719ce71-1859-4749-86eb-0a84bffaeb48 HTTP/1.1 Apr 14 18:54:01 user devstack@n-api.service[61674]: Accept: application/json Apr 14 18:54:01 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 18:54:01 user devstack@n-api.service[61674]: Connection: close Apr 14 18:54:01 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 18:54:01 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 18:54:01 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 18:54:01 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 18:54:01 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 18:54:01 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOaE8QdjtyvZQO6zvhGYql9ckzQom7oc469JH6qLPRSMXblj7ysc1U8qFbkMYSVWP7otih2UwCm7iyswyjiPtBGw_D4nimquJnqGtZchdBgwxr0NzM8n57BobSV0tSmrVsx0ER0uFF7hO8zu218DgTt-DJPkCvILdKDKVrtkH5Jmr61c Apr 14 18:54:01 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 18:54:01 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 18:54:01 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 18:54:01 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 18:54:01 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 18:54:01 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 18:54:01 user devstack@n-api.service[61674]: X-Project-Id: b4f0ac9ddf6648b79653e4cbf5cec954 Apr 14 18:54:01 user devstack@n-api.service[61674]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-655505838 Apr 14 18:54:01 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 18:54:01 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 18:54:01 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4f0ac9ddf6648b79653e4cbf5cec954"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b4f0ac9ddf6648b79653e4cbf5cec954"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4f0ac9ddf6648b79653e4cbf5cec954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:54:01 user devstack@n-api.service[61674]: X-Tenant: tempest-VolumesSnapshotsTestJSON-655505838 Apr 14 18:54:01 user devstack@n-api.service[61674]: X-Tenant-Id: b4f0ac9ddf6648b79653e4cbf5cec954 Apr 14 18:54:01 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-655505838 Apr 14 18:54:01 user devstack@n-api.service[61674]: X-User: tempest-VolumesSnapshotsTestJSON-655505838-project-member Apr 14 18:54:01 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 18:54:01 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 18:54:01 user devstack@n-api.service[61674]: X-User-Id: 2d6aa5b433984449af07c666bc441539 Apr 14 18:54:01 user devstack@n-api.service[61674]: X-User-Name: tempest-VolumesSnapshotsTestJSON-655505838-project-member Apr 14 18:54:01 user devstack@n-api.service[61674]: method: Apr 14 18:54:01 user devstack@n-api.service[61674]: exception: Volume 3719ce71-1859-4749-86eb-0a84bffaeb48 could not be found. Apr 14 18:54:01 user devstack@n-api.service[61674]: action_args: {'id': '3719ce71-1859-4749-86eb-0a84bffaeb48'} Apr 14 18:54:01 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3719ce71-1859-4749-86eb-0a84bffaeb48 could not be found. (HTTP 404) (Request-ID: req-c53e0119-f211-48cb-bdcf-5763cfbfc3d4) Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3719ce71-1859-4749-86eb-0a84bffaeb48 could not be found. Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3719ce71-1859-4749-86eb-0a84bffaeb48 could not be found. Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3719ce71-1859-4749-86eb-0a84bffaeb48 could not be found. Apr 14 18:54:01 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:54:01 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-ae3fda29-0bdf-489f-a84e-e6ede384870c tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] Returning 404 to user: Volume 3719ce71-1859-4749-86eb-0a84bffaeb48 could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:54:01 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-ae3fda29-0bdf-489f-a84e-e6ede384870c tempest-VolumesSnapshotsTestJSON-655505838 tempest-VolumesSnapshotsTestJSON-655505838-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3719ce71-1859-4749-86eb-0a84bffaeb48" status: 404 len: 109 microversion: 2.1 time: 0.039441 Apr 14 18:54:01 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 172/509] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 18:54:01 2023] GET /compute/v2.1/os-volumes/3719ce71-1859-4749-86eb-0a84bffaeb48 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:54:01 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-385b8c6d-90c2-405e-8b9d-e67252b2a19f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:54:01 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-385b8c6d-90c2-405e-8b9d-e67252b2a19f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:54:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-385b8c6d-90c2-405e-8b9d-e67252b2a19f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-385b8c6d-90c2-405e-8b9d-e67252b2a19f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-385b8c6d-90c2-405e-8b9d-e67252b2a19f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-385b8c6d-90c2-405e-8b9d-e67252b2a19f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-385b8c6d-90c2-405e-8b9d-e67252b2a19f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-385b8c6d-90c2-405e-8b9d-e67252b2a19f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:02 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-385b8c6d-90c2-405e-8b9d-e67252b2a19f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e1d31c2d9048699758779dedf7d3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6b4e98cf9e4f96b79c3288dfe0da89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:54:02 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-385b8c6d-90c2-405e-8b9d-e67252b2a19f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653" status: 200 len: 1537 microversion: 2.1 time: 0.302281 Apr 14 18:54:02 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 168/510] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:54:01 2023] GET /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653 => generated 1537 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:54:04 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-ba9e07c8-c9da-4bc3-aefa-e92b5e7c7eba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:54:04 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-ba9e07c8-c9da-4bc3-aefa-e92b5e7c7eba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:54:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ba9e07c8-c9da-4bc3-aefa-e92b5e7c7eba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ba9e07c8-c9da-4bc3-aefa-e92b5e7c7eba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ba9e07c8-c9da-4bc3-aefa-e92b5e7c7eba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ba9e07c8-c9da-4bc3-aefa-e92b5e7c7eba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ba9e07c8-c9da-4bc3-aefa-e92b5e7c7eba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ba9e07c8-c9da-4bc3-aefa-e92b5e7c7eba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:04 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-ba9e07c8-c9da-4bc3-aefa-e92b5e7c7eba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8713ed85ffb4446847f5ded4bc2e399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60e8abd123e414f847c68ba72894689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:54:04 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-ba9e07c8-c9da-4bc3-aefa-e92b5e7c7eba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d305ab4-1813-4728-a01c-287e521a05ec" status: 200 len: 1504 microversion: 2.1 time: 0.216451 Apr 14 18:54:04 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 171/511] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:54:04 2023] GET /compute/v2.1/servers/1d305ab4-1813-4728-a01c-287e521a05ec => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:54:09 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-cfd55843-1eb5-4d91-b9bd-2ac9a24dc54a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:54:09 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-cfd55843-1eb5-4d91-b9bd-2ac9a24dc54a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:54:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-cfd55843-1eb5-4d91-b9bd-2ac9a24dc54a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-cfd55843-1eb5-4d91-b9bd-2ac9a24dc54a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-cfd55843-1eb5-4d91-b9bd-2ac9a24dc54a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-cfd55843-1eb5-4d91-b9bd-2ac9a24dc54a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-cfd55843-1eb5-4d91-b9bd-2ac9a24dc54a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-cfd55843-1eb5-4d91-b9bd-2ac9a24dc54a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:09 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-cfd55843-1eb5-4d91-b9bd-2ac9a24dc54a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:54:09 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-cfd55843-1eb5-4d91-b9bd-2ac9a24dc54a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 200 len: 1675 microversion: 2.1 time: 0.254149 Apr 14 18:54:09 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 173/512] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:54:09 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 1675 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:54:09 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1aca5780-bd08-43d5-af3e-b06f7501fdbe"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:54:09 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:54:09 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:09 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:09 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:09 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:09 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:09 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:09 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "POST /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280194 Apr 14 18:54:09 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 169/513] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 18:54:09 2023] POST /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:54:17 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:54:17 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:54:17 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:54:17 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=6 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:54:17 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:17 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:17 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:17 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:17 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:17 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:17 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:54:17 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Old instance type m1.nano, new instance type m1.micro {{(pid=61675) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 14 18:54:17 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:17 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:17 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:17 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:17 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:17 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:17 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting quotas for project f028a79640b848228dc6e654a0eef49b. Resources: {'ram', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:54:17 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting quotas for user 55fa4abe2fdd48cb91f39bf8156a7793 and project f028a79640b848228dc6e654a0eef49b. Resources: {'ram', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:54:17 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flavor limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:54:17 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Image limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:54:17 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flavor pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:54:17 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Image pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:54:17 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:54:17 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "POST /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be/action" status: 202 len: 0 microversion: 2.1 time: 0.293253 Apr 14 18:54:17 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 172/514] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 18:54:17 2023] POST /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:54:17 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-ab68684d-b76e-4765-a102-88a14926edbc tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:54:17 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-ab68684d-b76e-4765-a102-88a14926edbc tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:54:17 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ab68684d-b76e-4765-a102-88a14926edbc tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:17 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ab68684d-b76e-4765-a102-88a14926edbc tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:17 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ab68684d-b76e-4765-a102-88a14926edbc tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:17 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ab68684d-b76e-4765-a102-88a14926edbc tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:17 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ab68684d-b76e-4765-a102-88a14926edbc tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:17 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ab68684d-b76e-4765-a102-88a14926edbc tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:17 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-ab68684d-b76e-4765-a102-88a14926edbc tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:54:17 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-ab68684d-b76e-4765-a102-88a14926edbc tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 200 len: 1730 microversion: 2.1 time: 0.255985 Apr 14 18:54:17 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 174/515] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:54:17 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 1730 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:54:20 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=6 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:54:20 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:54:20 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-da2da99b-0109-4439-b6b8-3eb115fe6da4 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:54:20 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-da2da99b-0109-4439-b6b8-3eb115fe6da4 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:54:20 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-da2da99b-0109-4439-b6b8-3eb115fe6da4 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:20 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-da2da99b-0109-4439-b6b8-3eb115fe6da4 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:20 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-da2da99b-0109-4439-b6b8-3eb115fe6da4 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:20 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-da2da99b-0109-4439-b6b8-3eb115fe6da4 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:20 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-da2da99b-0109-4439-b6b8-3eb115fe6da4 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:20 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-da2da99b-0109-4439-b6b8-3eb115fe6da4 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:20 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-da2da99b-0109-4439-b6b8-3eb115fe6da4 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] HTTP exception thrown: Instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c could not be found. Apr 14 18:54:20 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-da2da99b-0109-4439-b6b8-3eb115fe6da4 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Request method failure captured: Apr 14 18:54:20 user devstack@n-api.service[61673]: request: GET /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c HTTP/1.1 Apr 14 18:54:20 user devstack@n-api.service[61673]: Accept: application/json Apr 14 18:54:20 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 18:54:20 user devstack@n-api.service[61673]: Connection: close Apr 14 18:54:20 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 18:54:20 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 18:54:20 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 18:54:20 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 18:54:20 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 18:54:20 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOZ9rPU7WoJBzTAv6ZMSRjUBrlXKaPnn9FvjHFu_6CcpPw_LADzf3UWHRO88AC3-72xdw_uBMyyvjmtCL5IBYCWE2yV8Nqa7eggumLOH5_jn_SHwcHYpn_K3XZQvepyIjbtdkT4bJxZTR_FndDmkWWZo5mJq2ezB0-i6DweSqUxMtkS8 Apr 14 18:54:20 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 18:54:20 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 18:54:20 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 18:54:20 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 18:54:20 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 18:54:20 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 18:54:20 user devstack@n-api.service[61673]: X-Project-Id: 64d84c59848f445a90eb7eab6be04253 Apr 14 18:54:20 user devstack@n-api.service[61673]: X-Project-Name: tempest-ServerStableDeviceRescueTest-728638156 Apr 14 18:54:20 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 18:54:20 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 18:54:20 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64d84c59848f445a90eb7eab6be04253"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/64d84c59848f445a90eb7eab6be04253"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64d84c59848f445a90eb7eab6be04253"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:54:20 user devstack@n-api.service[61673]: X-Tenant: tempest-ServerStableDeviceRescueTest-728638156 Apr 14 18:54:20 user devstack@n-api.service[61673]: X-Tenant-Id: 64d84c59848f445a90eb7eab6be04253 Apr 14 18:54:20 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-728638156 Apr 14 18:54:20 user devstack@n-api.service[61673]: X-User: tempest-ServerStableDeviceRescueTest-728638156-project-member Apr 14 18:54:20 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 18:54:20 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 18:54:20 user devstack@n-api.service[61673]: X-User-Id: 83ed7885e7774691b02c19cf08c2177f Apr 14 18:54:20 user devstack@n-api.service[61673]: X-User-Name: tempest-ServerStableDeviceRescueTest-728638156-project-member Apr 14 18:54:20 user devstack@n-api.service[61673]: method: > Apr 14 18:54:20 user devstack@n-api.service[61673]: exception: Instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c could not be found. Apr 14 18:54:20 user devstack@n-api.service[61673]: action_args: {'id': '8e55c721-9fad-4478-9e74-e87d0c95bc3c'} Apr 14 18:54:20 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c could not be found. Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c could not be found. Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c could not be found. Apr 14 18:54:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:54:20 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-da2da99b-0109-4439-b6b8-3eb115fe6da4 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Returning 404 to user: Instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:54:20 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-da2da99b-0109-4439-b6b8-3eb115fe6da4 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c" status: 404 len: 111 microversion: 2.1 time: 0.044377 Apr 14 18:54:20 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 170/516] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:54:20 2023] GET /compute/v2.1/servers/8e55c721-9fad-4478-9e74-e87d0c95bc3c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:54:20 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-78201dff-c86b-4d33-b82c-0d01c83c5044 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Calling method '.version_select at 0x7fdae11eeef0>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:54:20 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-78201dff-c86b-4d33-b82c-0d01c83c5044 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1040648644" status: 202 len: 0 microversion: 2.1 time: 0.036215 Apr 14 18:54:20 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 173/517] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 18:54:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1040648644 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:54:20 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-192f3dbd-efdd-446e-9a7a-2713dbed6604 req-7a3a7093-9148-4b16-9f33-4b06bf548345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa09363f-435d-4fa8-9f11-db0c3f4e08be", "name": "network-vif-unplugged", "status": "completed", "tag": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:54:20 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-192f3dbd-efdd-446e-9a7a-2713dbed6604 req-7a3a7093-9148-4b16-9f33-4b06bf548345 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:20 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-192f3dbd-efdd-446e-9a7a-2713dbed6604 req-7a3a7093-9148-4b16-9f33-4b06bf548345 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:20 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-192f3dbd-efdd-446e-9a7a-2713dbed6604 req-7a3a7093-9148-4b16-9f33-4b06bf548345 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:20 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-192f3dbd-efdd-446e-9a7a-2713dbed6604 req-7a3a7093-9148-4b16-9f33-4b06bf548345 service nova] Creating event network-vif-unplugged:2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance aa09363f-435d-4fa8-9f11-db0c3f4e08be on user Apr 14 18:54:20 user devstack@n-api.service[61674]: DEBUG nova.compute.api [req-192f3dbd-efdd-446e-9a7a-2713dbed6604 req-7a3a7093-9148-4b16-9f33-4b06bf548345 service nova] Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61674) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 18:54:20 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-192f3dbd-efdd-446e-9a7a-2713dbed6604 req-7a3a7093-9148-4b16-9f33-4b06bf548345 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052606 Apr 14 18:54:20 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 175/518] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:54:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:54:22 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-d305c143-9051-45f8-a933-c4f6d650e697 req-2775f0e2-2707-4b0f-831b-092e227f2d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa09363f-435d-4fa8-9f11-db0c3f4e08be", "name": "network-vif-plugged", "status": "completed", "tag": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:54:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-d305c143-9051-45f8-a933-c4f6d650e697 req-2775f0e2-2707-4b0f-831b-092e227f2d79 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-d305c143-9051-45f8-a933-c4f6d650e697 req-2775f0e2-2707-4b0f-831b-092e227f2d79 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-d305c143-9051-45f8-a933-c4f6d650e697 req-2775f0e2-2707-4b0f-831b-092e227f2d79 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:22 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-d305c143-9051-45f8-a933-c4f6d650e697 req-2775f0e2-2707-4b0f-831b-092e227f2d79 service nova] Creating event network-vif-plugged:2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance aa09363f-435d-4fa8-9f11-db0c3f4e08be on user Apr 14 18:54:22 user devstack@n-api.service[61673]: DEBUG nova.compute.api [req-d305c143-9051-45f8-a933-c4f6d650e697 req-2775f0e2-2707-4b0f-831b-092e227f2d79 service nova] Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61673) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 18:54:22 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-d305c143-9051-45f8-a933-c4f6d650e697 req-2775f0e2-2707-4b0f-831b-092e227f2d79 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043898 Apr 14 18:54:22 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 171/519] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:54:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:54:24 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-6758a171-a743-494c-8cd1-677e48778366 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:54:24 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-6758a171-a743-494c-8cd1-677e48778366 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:54:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-6758a171-a743-494c-8cd1-677e48778366 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-6758a171-a743-494c-8cd1-677e48778366 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-6758a171-a743-494c-8cd1-677e48778366 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-6758a171-a743-494c-8cd1-677e48778366 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-6758a171-a743-494c-8cd1-677e48778366 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-6758a171-a743-494c-8cd1-677e48778366 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:24 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-6758a171-a743-494c-8cd1-677e48778366 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008a24026e844252b0be1268461bc2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af68184e7654efea3187e05bb10e5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:54:24 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-6758a171-a743-494c-8cd1-677e48778366 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97aafe40-5587-41cf-ba75-6077d9daa7eb" status: 200 len: 1494 microversion: 2.1 time: 0.417433 Apr 14 18:54:24 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 174/520] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:54:24 2023] GET /compute/v2.1/servers/97aafe40-5587-41cf-ba75-6077d9daa7eb => generated 1494 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:54:25 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-d8012566-2d66-4ca4-a1b3-996147ccb213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:54:25 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-d8012566-2d66-4ca4-a1b3-996147ccb213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:54:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d8012566-2d66-4ca4-a1b3-996147ccb213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d8012566-2d66-4ca4-a1b3-996147ccb213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d8012566-2d66-4ca4-a1b3-996147ccb213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d8012566-2d66-4ca4-a1b3-996147ccb213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d8012566-2d66-4ca4-a1b3-996147ccb213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d8012566-2d66-4ca4-a1b3-996147ccb213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:25 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-d8012566-2d66-4ca4-a1b3-996147ccb213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f90c8f23e3b42a98fdb9261db65f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf25bcc0dea4d3eb1284e8995eb3466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:54:25 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-d8012566-2d66-4ca4-a1b3-996147ccb213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4" status: 200 len: 1689 microversion: 2.1 time: 0.250500 Apr 14 18:54:25 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 176/521] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:54:25 2023] GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4 => generated 1689 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:54:31 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-7e26e383-2ac0-4834-9a87-db53c5f33c50 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:54:31 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-7e26e383-2ac0-4834-9a87-db53c5f33c50 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:54:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-7e26e383-2ac0-4834-9a87-db53c5f33c50 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-7e26e383-2ac0-4834-9a87-db53c5f33c50 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-7e26e383-2ac0-4834-9a87-db53c5f33c50 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-7e26e383-2ac0-4834-9a87-db53c5f33c50 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-7e26e383-2ac0-4834-9a87-db53c5f33c50 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-7e26e383-2ac0-4834-9a87-db53c5f33c50 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:32 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-7e26e383-2ac0-4834-9a87-db53c5f33c50 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e3f2dda9bc49f48c66beb978dbdaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0091007734312b8d33caf294d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:54:32 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-7e26e383-2ac0-4834-9a87-db53c5f33c50 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2a860bd-802f-4760-b77b-92b7ac4ad09b" status: 200 len: 1498 microversion: 2.1 time: 0.258172 Apr 14 18:54:32 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 172/522] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:54:31 2023] GET /compute/v2.1/servers/a2a860bd-802f-4760-b77b-92b7ac4ad09b => generated 1498 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:54:32 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-b3abf097-efd5-4077-911a-0b5668ae9a83 req-5f862402-b61d-4706-980b-ee807030e7e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa09363f-435d-4fa8-9f11-db0c3f4e08be", "name": "network-vif-plugged", "status": "completed", "tag": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:54:32 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=3 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:54:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-b3abf097-efd5-4077-911a-0b5668ae9a83 req-5f862402-b61d-4706-980b-ee807030e7e9 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-b3abf097-efd5-4077-911a-0b5668ae9a83 req-5f862402-b61d-4706-980b-ee807030e7e9 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-b3abf097-efd5-4077-911a-0b5668ae9a83 req-5f862402-b61d-4706-980b-ee807030e7e9 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:32 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-b3abf097-efd5-4077-911a-0b5668ae9a83 req-5f862402-b61d-4706-980b-ee807030e7e9 service nova] Creating event network-vif-plugged:2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance aa09363f-435d-4fa8-9f11-db0c3f4e08be on user Apr 14 18:54:32 user devstack@n-api.service[61675]: DEBUG nova.compute.api [req-b3abf097-efd5-4077-911a-0b5668ae9a83 req-5f862402-b61d-4706-980b-ee807030e7e9 service nova] Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61675) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 18:54:32 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-b3abf097-efd5-4077-911a-0b5668ae9a83 req-5f862402-b61d-4706-980b-ee807030e7e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053642 Apr 14 18:54:32 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 175/523] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:54:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:54:34 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-758523543", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "networks": [{"uuid": "a4933fe8-a8cc-498f-925f-185cdae2f1f7"}]}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:54:34 user devstack@n-api.service[61674]: DEBUG nova.network.neutron [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] validate_networks() for [('a4933fe8-a8cc-498f-925f-185cdae2f1f7', None, None, None, None, None)] {{(pid=61674) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:54:34 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-8012bbf6-2a94-4385-a957-4d59ef6436d1 req-6ae47f8c-7f9e-4909-bdf6-f44b0f33c343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa09363f-435d-4fa8-9f11-db0c3f4e08be", "name": "network-vif-plugged", "status": "completed", "tag": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:54:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-8012bbf6-2a94-4385-a957-4d59ef6436d1 req-6ae47f8c-7f9e-4909-bdf6-f44b0f33c343 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-8012bbf6-2a94-4385-a957-4d59ef6436d1 req-6ae47f8c-7f9e-4909-bdf6-f44b0f33c343 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-8012bbf6-2a94-4385-a957-4d59ef6436d1 req-6ae47f8c-7f9e-4909-bdf6-f44b0f33c343 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:34 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-8012bbf6-2a94-4385-a957-4d59ef6436d1 req-6ae47f8c-7f9e-4909-bdf6-f44b0f33c343 service nova] Creating event network-vif-plugged:2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance aa09363f-435d-4fa8-9f11-db0c3f4e08be on user Apr 14 18:54:34 user devstack@n-api.service[61673]: DEBUG nova.compute.api [req-8012bbf6-2a94-4385-a957-4d59ef6436d1 req-6ae47f8c-7f9e-4909-bdf6-f44b0f33c343 service nova] Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61673) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 18:54:34 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-8012bbf6-2a94-4385-a957-4d59ef6436d1 req-6ae47f8c-7f9e-4909-bdf6-f44b0f33c343 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058033 Apr 14 18:54:34 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 173/524] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:54:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:54:35 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Flavor limits 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:54:35 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Image limits 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:54:35 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Flavor pref 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:54:35 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Image pref 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:54:35 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:54:35 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:35 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:35 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:35 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:35 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:35 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:35 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Getting quotas for project 424e732759884efa8fd126cd9a082c8a. Resources: {'ram', 'instances', 'cores'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:54:35 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Getting quotas for user a644b8bb9b90494ba670da8315bfe005 and project 424e732759884efa8fd126cd9a082c8a. Resources: {'ram', 'instances', 'cores'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:54:35 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Going to run 1 instances... {{(pid=61674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:54:35 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:54:35 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.112652 Apr 14 18:54:35 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 177/525] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 18:54:34 2023] POST /compute/v2.1/servers => generated 378 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 18:54:35 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-0f6cc5cd-a522-4716-b7b3-8ad78409efbe tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:54:35 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-0f6cc5cd-a522-4716-b7b3-8ad78409efbe tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:54:35 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-b8401ad6-8089-4212-87c9-694eb3b8452a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:54:35 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-b8401ad6-8089-4212-87c9-694eb3b8452a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:54:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-0f6cc5cd-a522-4716-b7b3-8ad78409efbe tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-0f6cc5cd-a522-4716-b7b3-8ad78409efbe tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-0f6cc5cd-a522-4716-b7b3-8ad78409efbe tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-0f6cc5cd-a522-4716-b7b3-8ad78409efbe tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-0f6cc5cd-a522-4716-b7b3-8ad78409efbe tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-0f6cc5cd-a522-4716-b7b3-8ad78409efbe tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:35 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-b8401ad6-8089-4212-87c9-694eb3b8452a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:54:35 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-b8401ad6-8089-4212-87c9-694eb3b8452a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:54:35 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-b8401ad6-8089-4212-87c9-694eb3b8452a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:54:35 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-b8401ad6-8089-4212-87c9-694eb3b8452a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e79e2cb-54c5-487e-b852-49303ee3e3cc" status: 200 len: 1394 microversion: 2.87 time: 0.133261 Apr 14 18:54:35 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 176/526] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:54:35 2023] GET /compute/v2.1/servers/6e79e2cb-54c5-487e-b852-49303ee3e3cc => generated 1394 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:54:35 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-0f6cc5cd-a522-4716-b7b3-8ad78409efbe tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.325186 Apr 14 18:54:35 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 174/527] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 18:54:35 2023] GET /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38/os-interface => generated 282 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:54:37 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-c552625b-761d-4d02-84cf-58be7eb3b01e req-432ace2c-f782-4776-ac3b-4b82f1853bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61944d61-738b-42a7-a95d-8caa6fa29a38", "tag": "62d648bd-cf77-401d-abcf-b4f95e339dc9"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:54:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-c552625b-761d-4d02-84cf-58be7eb3b01e req-432ace2c-f782-4776-ac3b-4b82f1853bc6 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-c552625b-761d-4d02-84cf-58be7eb3b01e req-432ace2c-f782-4776-ac3b-4b82f1853bc6 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-c552625b-761d-4d02-84cf-58be7eb3b01e req-432ace2c-f782-4776-ac3b-4b82f1853bc6 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:37 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-c552625b-761d-4d02-84cf-58be7eb3b01e req-432ace2c-f782-4776-ac3b-4b82f1853bc6 service nova] Creating event network-changed:62d648bd-cf77-401d-abcf-b4f95e339dc9 for instance 61944d61-738b-42a7-a95d-8caa6fa29a38 on user Apr 14 18:54:37 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-4a25b109-6062-4444-9b20-5219f95a256c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:54:37 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-4a25b109-6062-4444-9b20-5219f95a256c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:54:37 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-c552625b-761d-4d02-84cf-58be7eb3b01e req-432ace2c-f782-4776-ac3b-4b82f1853bc6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055616 Apr 14 18:54:37 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 178/528] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:54:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 18:54:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-4a25b109-6062-4444-9b20-5219f95a256c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-4a25b109-6062-4444-9b20-5219f95a256c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-4a25b109-6062-4444-9b20-5219f95a256c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-4a25b109-6062-4444-9b20-5219f95a256c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-4a25b109-6062-4444-9b20-5219f95a256c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-4a25b109-6062-4444-9b20-5219f95a256c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:37 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-4a25b109-6062-4444-9b20-5219f95a256c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38/ips" status: 200 len: 107 microversion: 2.1 time: 0.071897 Apr 14 18:54:37 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 177/529] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 18:54:37 2023] GET /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38/ips => generated 107 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:54:39 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef45e048-9581-480e-be21-715dfeb0c8cd"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:54:39 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:54:39 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:39 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:39 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:39 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:39 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:39 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:40 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-b595754d-6d82-4821-be03-d3e1d0e1631c req-a26ea5e6-b5b7-4b1d-b8a7-ac41ea345139 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e79e2cb-54c5-487e-b852-49303ee3e3cc", "tag": "fdf3f209-95c6-4369-a6b6-13c2aed1371b"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:54:40 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:54:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-b595754d-6d82-4821-be03-d3e1d0e1631c req-a26ea5e6-b5b7-4b1d-b8a7-ac41ea345139 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-b595754d-6d82-4821-be03-d3e1d0e1631c req-a26ea5e6-b5b7-4b1d-b8a7-ac41ea345139 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-b595754d-6d82-4821-be03-d3e1d0e1631c req-a26ea5e6-b5b7-4b1d-b8a7-ac41ea345139 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:40 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=27 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:54:40 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-b595754d-6d82-4821-be03-d3e1d0e1631c req-a26ea5e6-b5b7-4b1d-b8a7-ac41ea345139 service nova] Creating event network-changed:fdf3f209-95c6-4369-a6b6-13c2aed1371b for instance 6e79e2cb-54c5-487e-b852-49303ee3e3cc on user Apr 14 18:54:40 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-b595754d-6d82-4821-be03-d3e1d0e1631c req-a26ea5e6-b5b7-4b1d-b8a7-ac41ea345139 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034884 Apr 14 18:54:40 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 179/530] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:54:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:54:40 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "POST /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.416879 Apr 14 18:54:40 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 175/531] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 18:54:39 2023] POST /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38/os-volume_attachments => generated 194 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:54:42 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-c436c5d2-03e2-415f-9668-9671911ea21f req-0c230d1d-5fd3-4a90-b537-fbb11591cc86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e79e2cb-54c5-487e-b852-49303ee3e3cc", "name": "network-vif-plugged", "status": "completed", "tag": "fdf3f209-95c6-4369-a6b6-13c2aed1371b"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:54:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-c436c5d2-03e2-415f-9668-9671911ea21f req-0c230d1d-5fd3-4a90-b537-fbb11591cc86 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-c436c5d2-03e2-415f-9668-9671911ea21f req-0c230d1d-5fd3-4a90-b537-fbb11591cc86 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-c436c5d2-03e2-415f-9668-9671911ea21f req-0c230d1d-5fd3-4a90-b537-fbb11591cc86 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:42 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-c436c5d2-03e2-415f-9668-9671911ea21f req-0c230d1d-5fd3-4a90-b537-fbb11591cc86 service nova] Creating event network-vif-plugged:fdf3f209-95c6-4369-a6b6-13c2aed1371b for instance 6e79e2cb-54c5-487e-b852-49303ee3e3cc on user Apr 14 18:54:43 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-c436c5d2-03e2-415f-9668-9671911ea21f req-0c230d1d-5fd3-4a90-b537-fbb11591cc86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052795 Apr 14 18:54:43 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 178/532] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:54:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 18:54:45 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-ff535655-fc35-4435-9431-fbbf10aee695 req-9224197b-2409-42ed-b15c-d9874ded1c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e79e2cb-54c5-487e-b852-49303ee3e3cc", "name": "network-vif-plugged", "status": "completed", "tag": "fdf3f209-95c6-4369-a6b6-13c2aed1371b"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:54:45 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-ff535655-fc35-4435-9431-fbbf10aee695 req-9224197b-2409-42ed-b15c-d9874ded1c95 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:45 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-ff535655-fc35-4435-9431-fbbf10aee695 req-9224197b-2409-42ed-b15c-d9874ded1c95 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:45 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-ff535655-fc35-4435-9431-fbbf10aee695 req-9224197b-2409-42ed-b15c-d9874ded1c95 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:45 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-ff535655-fc35-4435-9431-fbbf10aee695 req-9224197b-2409-42ed-b15c-d9874ded1c95 service nova] Creating event network-vif-plugged:fdf3f209-95c6-4369-a6b6-13c2aed1371b for instance 6e79e2cb-54c5-487e-b852-49303ee3e3cc on user Apr 14 18:54:45 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-ff535655-fc35-4435-9431-fbbf10aee695 req-9224197b-2409-42ed-b15c-d9874ded1c95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034370 Apr 14 18:54:45 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 180/533] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:54:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:54:49 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-5a8d874c-2f89-49e0-990f-b13af3967980 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef45e048-9581-480e-be21-715dfeb0c8cd"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:54:49 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-5a8d874c-2f89-49e0-990f-b13af3967980 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:54:49 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5a8d874c-2f89-49e0-990f-b13af3967980 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:49 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5a8d874c-2f89-49e0-990f-b13af3967980 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:49 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5a8d874c-2f89-49e0-990f-b13af3967980 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:49 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5a8d874c-2f89-49e0-990f-b13af3967980 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:49 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5a8d874c-2f89-49e0-990f-b13af3967980 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:49 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5a8d874c-2f89-49e0-990f-b13af3967980 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:49 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-5a8d874c-2f89-49e0-990f-b13af3967980 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] HTTP exception thrown: Invalid volume: volume ef45e048-9581-480e-be21-715dfeb0c8cd is already attached to instances: 61944d61-738b-42a7-a95d-8caa6fa29a38 Apr 14 18:54:49 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-5a8d874c-2f89-49e0-990f-b13af3967980 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Request method failure captured: Apr 14 18:54:49 user devstack@n-api.service[61673]: request: POST /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38/os-volume_attachments HTTP/1.1 Apr 14 18:54:49 user devstack@n-api.service[61673]: Accept: application/json Apr 14 18:54:49 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 18:54:49 user devstack@n-api.service[61673]: Connection: close Apr 14 18:54:49 user devstack@n-api.service[61673]: Content-Length: 74 Apr 14 18:54:49 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 18:54:49 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 18:54:49 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 18:54:49 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 18:54:49 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOZ9mXKmSeVaIS46ajndcD0QEVOAAeNy4LVRU6htix22YmE3w_WsO57Wi55e6NRGyVz084DhOrXI8Tp0cfqtkOuptABoiofobC3zYryQ5y6CuXjmj_BNK8q3Ywj-icF3eYh62IR4e0eJMk7NufTqqWbSFQxNccWUoyS1F1P0cbefqlTY Apr 14 18:54:49 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 18:54:49 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 18:54:49 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 18:54:49 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 18:54:49 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 18:54:49 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 18:54:49 user devstack@n-api.service[61673]: X-Project-Id: e34cdebcd7154988a957deae140e8eab Apr 14 18:54:49 user devstack@n-api.service[61673]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 18:54:49 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 18:54:49 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 18:54:49 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:54:49 user devstack@n-api.service[61673]: X-Tenant: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 18:54:49 user devstack@n-api.service[61673]: X-Tenant-Id: e34cdebcd7154988a957deae140e8eab Apr 14 18:54:49 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 18:54:49 user devstack@n-api.service[61673]: X-User: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 18:54:49 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 18:54:49 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 18:54:49 user devstack@n-api.service[61673]: X-User-Id: 8d53edaffb8f4038abd366d7942c6bc7 Apr 14 18:54:49 user devstack@n-api.service[61673]: X-User-Name: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 18:54:49 user devstack@n-api.service[61673]: Apr 14 18:54:49 user devstack@n-api.service[61673]: {"volumeAttachment": {"volumeId": "ef45e048-9581-480e-be21-715dfeb0c8cd"}} Apr 14 18:54:49 user devstack@n-api.service[61673]: method: > Apr 14 18:54:49 user devstack@n-api.service[61673]: exception: Invalid volume: volume ef45e048-9581-480e-be21-715dfeb0c8cd is already attached to instances: 61944d61-738b-42a7-a95d-8caa6fa29a38 Apr 14 18:54:49 user devstack@n-api.service[61673]: action_args: {'server_id': '61944d61-738b-42a7-a95d-8caa6fa29a38', 'body': {'volumeAttachment': {'volumeId': 'ef45e048-9581-480e-be21-715dfeb0c8cd'}}} Apr 14 18:54:49 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ef45e048-9581-480e-be21-715dfeb0c8cd is already attached to instances: 61944d61-738b-42a7-a95d-8caa6fa29a38 Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ef45e048-9581-480e-be21-715dfeb0c8cd is already attached to instances: 61944d61-738b-42a7-a95d-8caa6fa29a38 Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ef45e048-9581-480e-be21-715dfeb0c8cd is already attached to instances: 61944d61-738b-42a7-a95d-8caa6fa29a38 Apr 14 18:54:49 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:54:49 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-5a8d874c-2f89-49e0-990f-b13af3967980 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Returning 400 to user: Invalid volume: volume ef45e048-9581-480e-be21-715dfeb0c8cd is already attached to instances: 61944d61-738b-42a7-a95d-8caa6fa29a38 {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:54:49 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-5a8d874c-2f89-49e0-990f-b13af3967980 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "POST /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.178191 Apr 14 18:54:49 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 176/534] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 18:54:49 2023] POST /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38/os-volume_attachments => generated 174 bytes in 180 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 18:54:49 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:54:49 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:54:49 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:54:49 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:54:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:49 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:54:49 user devstack@n-api.service[61675]: DEBUG nova.objects.instance [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lazy-loading 'services' on Instance uuid 61944d61-738b-42a7-a95d-8caa6fa29a38 {{(pid=61675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 18:54:49 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38/os-volume_attachments/ef45e048-9581-480e-be21-715dfeb0c8cd" status: 202 len: 0 microversion: 2.1 time: 0.242979 Apr 14 18:54:49 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 179/535] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 18:54:49 2023] DELETE /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38/os-volume_attachments/ef45e048-9581-480e-be21-715dfeb0c8cd => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:54:49 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:54:49 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=6 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:54:49 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-05eefa45-0784-484f-8806-7bcb3ec9df61 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:54:49 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-05eefa45-0784-484f-8806-7bcb3ec9df61 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:54:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-05eefa45-0784-484f-8806-7bcb3ec9df61 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-05eefa45-0784-484f-8806-7bcb3ec9df61 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-05eefa45-0784-484f-8806-7bcb3ec9df61 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-05eefa45-0784-484f-8806-7bcb3ec9df61 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:54:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-05eefa45-0784-484f-8806-7bcb3ec9df61 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:54:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-05eefa45-0784-484f-8806-7bcb3ec9df61 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:54:49 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-05eefa45-0784-484f-8806-7bcb3ec9df61 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094444 Apr 14 18:54:49 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 181/536] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:54:49 2023] GET /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:55:02 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-bf658127-9510-41b1-b49d-9f0c6f836bba tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:55:02 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-bf658127-9510-41b1-b49d-9f0c6f836bba tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:55:02 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=14 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:55:02 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:55:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bf658127-9510-41b1-b49d-9f0c6f836bba tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bf658127-9510-41b1-b49d-9f0c6f836bba tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bf658127-9510-41b1-b49d-9f0c6f836bba tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bf658127-9510-41b1-b49d-9f0c6f836bba tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bf658127-9510-41b1-b49d-9f0c6f836bba tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bf658127-9510-41b1-b49d-9f0c6f836bba tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:02 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-bf658127-9510-41b1-b49d-9f0c6f836bba tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e1d31c2d9048699758779dedf7d3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6b4e98cf9e4f96b79c3288dfe0da89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:55:02 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-bf658127-9510-41b1-b49d-9f0c6f836bba tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653" status: 200 len: 1537 microversion: 2.1 time: 0.268623 Apr 14 18:55:02 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 177/537] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:55:02 2023] GET /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653 => generated 1537 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:55:02 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:55:02 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=8,nova_cell1:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:55:02 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-f0441331-b220-4b28-b253-bd137660a15c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:55:02 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-f0441331-b220-4b28-b253-bd137660a15c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67e1d31c2d9048699758779dedf7d3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6b4e98cf9e4f96b79c3288dfe0da89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:55:02 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-f0441331-b220-4b28-b253-bd137660a15c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Searching by: {'deleted': False, 'project_id': '8e6b4e98cf9e4f96b79c3288dfe0da89'} {{(pid=61675) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 14 18:55:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f0441331-b220-4b28-b253-bd137660a15c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f0441331-b220-4b28-b253-bd137660a15c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f0441331-b220-4b28-b253-bd137660a15c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f0441331-b220-4b28-b253-bd137660a15c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f0441331-b220-4b28-b253-bd137660a15c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f0441331-b220-4b28-b253-bd137660a15c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:02 user devstack@n-api.service[61675]: DEBUG nova.compute.multi_cell_list [None req-f0441331-b220-4b28-b253-bd137660a15c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61675) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 14 18:55:02 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-f0441331-b220-4b28-b253-bd137660a15c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.225179 Apr 14 18:55:02 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 180/538] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 14 18:55:02 2023] GET /compute/v2.1/servers => generated 341 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:55:02 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-e1a32af4-cade-455e-938a-7434989b2e1d tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:55:02 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-e1a32af4-cade-455e-938a-7434989b2e1d tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:55:02 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=5 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:55:02 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=9 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:55:02 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e1a32af4-cade-455e-938a-7434989b2e1d tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:02 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e1a32af4-cade-455e-938a-7434989b2e1d tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:02 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e1a32af4-cade-455e-938a-7434989b2e1d tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:02 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e1a32af4-cade-455e-938a-7434989b2e1d tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:02 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e1a32af4-cade-455e-938a-7434989b2e1d tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:02 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e1a32af4-cade-455e-938a-7434989b2e1d tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:02 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-e1a32af4-cade-455e-938a-7434989b2e1d tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e1d31c2d9048699758779dedf7d3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6b4e98cf9e4f96b79c3288dfe0da89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:55:02 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-e1a32af4-cade-455e-938a-7434989b2e1d tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653" status: 200 len: 1537 microversion: 2.1 time: 0.240328 Apr 14 18:55:02 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 182/539] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:55:02 2023] GET /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653 => generated 1537 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:55:05 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:05 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:55:05 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:05 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:05 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:05 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:05 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:05 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:06 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.348289 Apr 14 18:55:06 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 178/540] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 18:55:05 2023] POST /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653/os-volume_attachments => generated 194 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:55:07 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-5fa19edd-3883-4fe7-8e88-0197bad41723 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:55:07 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-5fa19edd-3883-4fe7-8e88-0197bad41723 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:55:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-5fa19edd-3883-4fe7-8e88-0197bad41723 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-5fa19edd-3883-4fe7-8e88-0197bad41723 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-5fa19edd-3883-4fe7-8e88-0197bad41723 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-5fa19edd-3883-4fe7-8e88-0197bad41723 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-5fa19edd-3883-4fe7-8e88-0197bad41723 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-5fa19edd-3883-4fe7-8e88-0197bad41723 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:08 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-5fa19edd-3883-4fe7-8e88-0197bad41723 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:55:08 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-5fa19edd-3883-4fe7-8e88-0197bad41723 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 200 len: 1729 microversion: 2.1 time: 0.287231 Apr 14 18:55:08 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 181/541] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:55:07 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 1729 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:55:09 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:09 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:55:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:09 user devstack@n-api.service[61674]: DEBUG nova.objects.instance [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'flavor' on Instance uuid 1d305ab4-1813-4728-a01c-287e521a05ec {{(pid=61674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 18:55:09 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1d305ab4-1813-4728-a01c-287e521a05ec/action" status: 200 len: 32 microversion: 2.1 time: 0.118922 Apr 14 18:55:09 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 183/542] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 18:55:09 2023] POST /compute/v2.1/servers/1d305ab4-1813-4728-a01c-287e521a05ec/action => generated 32 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 18:55:09 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-370e33e6-1cd1-407b-836f-3e2886327fd1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:55:09 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-370e33e6-1cd1-407b-836f-3e2886327fd1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:55:09 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-370e33e6-1cd1-407b-836f-3e2886327fd1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:09 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-370e33e6-1cd1-407b-836f-3e2886327fd1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:09 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-370e33e6-1cd1-407b-836f-3e2886327fd1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:09 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-370e33e6-1cd1-407b-836f-3e2886327fd1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:09 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-370e33e6-1cd1-407b-836f-3e2886327fd1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:09 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-370e33e6-1cd1-407b-836f-3e2886327fd1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:09 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-370e33e6-1cd1-407b-836f-3e2886327fd1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8713ed85ffb4446847f5ded4bc2e399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60e8abd123e414f847c68ba72894689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:55:09 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-370e33e6-1cd1-407b-836f-3e2886327fd1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d305ab4-1813-4728-a01c-287e521a05ec" status: 200 len: 1510 microversion: 2.1 time: 0.242458 Apr 14 18:55:09 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 179/543] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:55:09 2023] GET /compute/v2.1/servers/1d305ab4-1813-4728-a01c-287e521a05ec => generated 1510 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:55:10 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-e1fa9b86-2aec-404b-98dc-e2da74d763e5 req-0414983c-8d1f-4970-8178-f44cc2187ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d305ab4-1813-4728-a01c-287e521a05ec", "name": "network-vif-unplugged", "status": "completed", "tag": "d07ff847-3983-4b35-af36-fbd845ede770"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-e1fa9b86-2aec-404b-98dc-e2da74d763e5 req-0414983c-8d1f-4970-8178-f44cc2187ff4 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-e1fa9b86-2aec-404b-98dc-e2da74d763e5 req-0414983c-8d1f-4970-8178-f44cc2187ff4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-e1fa9b86-2aec-404b-98dc-e2da74d763e5 req-0414983c-8d1f-4970-8178-f44cc2187ff4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:10 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-e1fa9b86-2aec-404b-98dc-e2da74d763e5 req-0414983c-8d1f-4970-8178-f44cc2187ff4 service nova] Creating event network-vif-unplugged:d07ff847-3983-4b35-af36-fbd845ede770 for instance 1d305ab4-1813-4728-a01c-287e521a05ec on user Apr 14 18:55:10 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-e1fa9b86-2aec-404b-98dc-e2da74d763e5 req-0414983c-8d1f-4970-8178-f44cc2187ff4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038459 Apr 14 18:55:10 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 182/544] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:55:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:55:12 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-ec39c94b-9fe0-4c3d-a08f-6cea6830256f req-34086261-d28b-48c0-a068-7912897bc7c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d305ab4-1813-4728-a01c-287e521a05ec", "name": "network-vif-plugged", "status": "completed", "tag": "d07ff847-3983-4b35-af36-fbd845ede770"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-ec39c94b-9fe0-4c3d-a08f-6cea6830256f req-34086261-d28b-48c0-a068-7912897bc7c6 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-ec39c94b-9fe0-4c3d-a08f-6cea6830256f req-34086261-d28b-48c0-a068-7912897bc7c6 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-ec39c94b-9fe0-4c3d-a08f-6cea6830256f req-34086261-d28b-48c0-a068-7912897bc7c6 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:12 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-ec39c94b-9fe0-4c3d-a08f-6cea6830256f req-34086261-d28b-48c0-a068-7912897bc7c6 service nova] Creating event network-vif-plugged:d07ff847-3983-4b35-af36-fbd845ede770 for instance 1d305ab4-1813-4728-a01c-287e521a05ec on user Apr 14 18:55:12 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-ec39c94b-9fe0-4c3d-a08f-6cea6830256f req-34086261-d28b-48c0-a068-7912897bc7c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034426 Apr 14 18:55:12 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 184/545] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:55:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:55:14 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-a1379ef3-1124-4494-a2e4-9206b1e19c71 req-a2745a8b-4dfc-4a85-8bfa-1710da0911a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d305ab4-1813-4728-a01c-287e521a05ec", "name": "network-vif-plugged", "status": "completed", "tag": "d07ff847-3983-4b35-af36-fbd845ede770"}, {"server_uuid": "1d305ab4-1813-4728-a01c-287e521a05ec", "name": "network-vif-plugged", "status": "completed", "tag": "d07ff847-3983-4b35-af36-fbd845ede770"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:14 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:55:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-a1379ef3-1124-4494-a2e4-9206b1e19c71 req-a2745a8b-4dfc-4a85-8bfa-1710da0911a2 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-a1379ef3-1124-4494-a2e4-9206b1e19c71 req-a2745a8b-4dfc-4a85-8bfa-1710da0911a2 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-a1379ef3-1124-4494-a2e4-9206b1e19c71 req-a2745a8b-4dfc-4a85-8bfa-1710da0911a2 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:14 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-0a2c7299-37e0-45e7-b3f8-247d558572e5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:55:14 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-0a2c7299-37e0-45e7-b3f8-247d558572e5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:55:14 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-a1379ef3-1124-4494-a2e4-9206b1e19c71 req-a2745a8b-4dfc-4a85-8bfa-1710da0911a2 service nova] Creating event network-vif-plugged:d07ff847-3983-4b35-af36-fbd845ede770 for instance 1d305ab4-1813-4728-a01c-287e521a05ec on user Apr 14 18:55:14 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-a1379ef3-1124-4494-a2e4-9206b1e19c71 req-a2745a8b-4dfc-4a85-8bfa-1710da0911a2 service nova] Creating event network-vif-plugged:d07ff847-3983-4b35-af36-fbd845ede770 for instance 1d305ab4-1813-4728-a01c-287e521a05ec on user Apr 14 18:55:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0a2c7299-37e0-45e7-b3f8-247d558572e5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0a2c7299-37e0-45e7-b3f8-247d558572e5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0a2c7299-37e0-45e7-b3f8-247d558572e5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0a2c7299-37e0-45e7-b3f8-247d558572e5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0a2c7299-37e0-45e7-b3f8-247d558572e5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0a2c7299-37e0-45e7-b3f8-247d558572e5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:14 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-a1379ef3-1124-4494-a2e4-9206b1e19c71 req-a2745a8b-4dfc-4a85-8bfa-1710da0911a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031984 Apr 14 18:55:14 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 180/546] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:55:14 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:55:15 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-0a2c7299-37e0-45e7-b3f8-247d558572e5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e1d31c2d9048699758779dedf7d3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6b4e98cf9e4f96b79c3288dfe0da89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:55:15 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-0a2c7299-37e0-45e7-b3f8-247d558572e5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653" status: 200 len: 1583 microversion: 2.1 time: 0.391873 Apr 14 18:55:15 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 183/547] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:55:14 2023] GET /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653 => generated 1583 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:55:17 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-98792215-3e51-406b-a284-7293cddb5823 req-02603373-f7a6-4599-8d3d-11c418c968a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cab14831-868c-40aa-b694-9e0185557653", "tag": "00582309-5b1a-4a4d-80b2-478c8f9ada29"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:17 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-98792215-3e51-406b-a284-7293cddb5823 req-02603373-f7a6-4599-8d3d-11c418c968a7 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:17 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-98792215-3e51-406b-a284-7293cddb5823 req-02603373-f7a6-4599-8d3d-11c418c968a7 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:17 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-98792215-3e51-406b-a284-7293cddb5823 req-02603373-f7a6-4599-8d3d-11c418c968a7 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:17 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-98792215-3e51-406b-a284-7293cddb5823 req-02603373-f7a6-4599-8d3d-11c418c968a7 service nova] Creating event network-changed:00582309-5b1a-4a4d-80b2-478c8f9ada29 for instance cab14831-868c-40aa-b694-9e0185557653 on user Apr 14 18:55:17 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-98792215-3e51-406b-a284-7293cddb5823 req-02603373-f7a6-4599-8d3d-11c418c968a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035111 Apr 14 18:55:17 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 185/548] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:55:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:55:17 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-d9b05acb-e471-4ede-b0fb-8ba718da0306 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Action: 'create', calling method: .version_select at 0x7fdae10377f0>, body: {"keypair": {"name": "tempest-TestStampPattern-580300982", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDx8M4QjbAb47cqa0IIK3DFtHC++DW5qjEMCJfo5EDtvaO/cl4OHImq2UJzNJC1zQSEajn+k79i0pWkmV4FFQZ3qK1iN0DjaB8oxSduo8LZXNaMWp9839OvzlCknJnwL1A=="}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:17 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-d9b05acb-e471-4ede-b0fb-8ba718da0306 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Getting quotas for project 921435d84194431c886ec1ed1848d4d6. Resources: {'key_pairs'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:55:17 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-d9b05acb-e471-4ede-b0fb-8ba718da0306 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Getting quotas for user 9a9414d0c24643fdb162aad828c736bd and project 921435d84194431c886ec1ed1848d4d6. Resources: {'key_pairs'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:55:17 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-d9b05acb-e471-4ede-b0fb-8ba718da0306 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.241343 Apr 14 18:55:17 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 181/549] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 18:55:17 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:55:18 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-db1b9644-7d4b-42f6-8daa-9ed8e0251de7 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-637075469"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:18 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-db1b9644-7d4b-42f6-8daa-9ed8e0251de7 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:55:18 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-db1b9644-7d4b-42f6-8daa-9ed8e0251de7 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:18 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-db1b9644-7d4b-42f6-8daa-9ed8e0251de7 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:18 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-db1b9644-7d4b-42f6-8daa-9ed8e0251de7 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:18 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-db1b9644-7d4b-42f6-8daa-9ed8e0251de7 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:18 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-db1b9644-7d4b-42f6-8daa-9ed8e0251de7 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:18 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-db1b9644-7d4b-42f6-8daa-9ed8e0251de7 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:18 user devstack@n-api.service[61675]: INFO nova.network.security_group_api [None req-db1b9644-7d4b-42f6-8daa-9ed8e0251de7 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Adding security group c18f669e-c0ac-4738-98c9-5e0bd068f15b to port 00582309-5b1a-4a4d-80b2-478c8f9ada29 Apr 14 18:55:19 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-db1b9644-7d4b-42f6-8daa-9ed8e0251de7 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653/action" status: 202 len: 0 microversion: 2.1 time: 0.686443 Apr 14 18:55:19 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 184/550] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 18:55:18 2023] POST /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653/action => generated 0 bytes in 688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:55:19 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-5ead74d1-62b8-4718-9673-3ad042fc8dba req-d411cdb3-0fde-4c0d-985b-12f4a979a8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cab14831-868c-40aa-b694-9e0185557653", "tag": "00582309-5b1a-4a4d-80b2-478c8f9ada29"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:19 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-a55fcab6-2ca8-45f1-929c-978736a0e3b6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:55:19 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-a55fcab6-2ca8-45f1-929c-978736a0e3b6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:55:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a55fcab6-2ca8-45f1-929c-978736a0e3b6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a55fcab6-2ca8-45f1-929c-978736a0e3b6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a55fcab6-2ca8-45f1-929c-978736a0e3b6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a55fcab6-2ca8-45f1-929c-978736a0e3b6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a55fcab6-2ca8-45f1-929c-978736a0e3b6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-5ead74d1-62b8-4718-9673-3ad042fc8dba req-d411cdb3-0fde-4c0d-985b-12f4a979a8f9 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a55fcab6-2ca8-45f1-929c-978736a0e3b6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-5ead74d1-62b8-4718-9673-3ad042fc8dba req-d411cdb3-0fde-4c0d-985b-12f4a979a8f9 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-5ead74d1-62b8-4718-9673-3ad042fc8dba req-d411cdb3-0fde-4c0d-985b-12f4a979a8f9 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:19 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-5ead74d1-62b8-4718-9673-3ad042fc8dba req-d411cdb3-0fde-4c0d-985b-12f4a979a8f9 service nova] Creating event network-changed:00582309-5b1a-4a4d-80b2-478c8f9ada29 for instance cab14831-868c-40aa-b694-9e0185557653 on user Apr 14 18:55:19 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-5ead74d1-62b8-4718-9673-3ad042fc8dba req-d411cdb3-0fde-4c0d-985b-12f4a979a8f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042184 Apr 14 18:55:19 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 186/551] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:55:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:55:19 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-a55fcab6-2ca8-45f1-929c-978736a0e3b6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e1d31c2d9048699758779dedf7d3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6b4e98cf9e4f96b79c3288dfe0da89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:55:19 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-a55fcab6-2ca8-45f1-929c-978736a0e3b6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653" status: 200 len: 1748 microversion: 2.1 time: 0.359196 Apr 14 18:55:19 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 182/552] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:55:19 2023] GET /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653 => generated 1748 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:55:19 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-e0251b1b-a7ea-4554-af21-19d512d2fb15 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:19 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-e0251b1b-a7ea-4554-af21-19d512d2fb15 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:55:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e0251b1b-a7ea-4554-af21-19d512d2fb15 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e0251b1b-a7ea-4554-af21-19d512d2fb15 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e0251b1b-a7ea-4554-af21-19d512d2fb15 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e0251b1b-a7ea-4554-af21-19d512d2fb15 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e0251b1b-a7ea-4554-af21-19d512d2fb15 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e0251b1b-a7ea-4554-af21-19d512d2fb15 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:19 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-e0251b1b-a7ea-4554-af21-19d512d2fb15 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653/action" status: 202 len: 0 microversion: 2.1 time: 0.136635 Apr 14 18:55:19 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 185/553] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 18:55:19 2023] POST /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:55:19 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-e410ae7c-f8da-4b6d-b37b-559124cf4db2 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:55:19 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-e410ae7c-f8da-4b6d-b37b-559124cf4db2 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:55:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e410ae7c-f8da-4b6d-b37b-559124cf4db2 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e410ae7c-f8da-4b6d-b37b-559124cf4db2 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e410ae7c-f8da-4b6d-b37b-559124cf4db2 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e410ae7c-f8da-4b6d-b37b-559124cf4db2 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e410ae7c-f8da-4b6d-b37b-559124cf4db2 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e410ae7c-f8da-4b6d-b37b-559124cf4db2 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:20 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-e410ae7c-f8da-4b6d-b37b-559124cf4db2 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e1d31c2d9048699758779dedf7d3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6b4e98cf9e4f96b79c3288dfe0da89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:55:20 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-e410ae7c-f8da-4b6d-b37b-559124cf4db2 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653" status: 200 len: 1740 microversion: 2.1 time: 0.189104 Apr 14 18:55:20 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 187/554] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:55:19 2023] GET /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653 => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:55:22 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1245634344", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "key_name": "tempest-TestStampPattern-580300982", "security_groups": [{"name": "tempest-secgroup-smoke-1172081860"}], "networks": [{"uuid": "1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37"}]}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:22 user devstack@n-api.service[61673]: DEBUG nova.network.neutron [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] validate_networks() for [('1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37', None, None, None, None, None)] {{(pid=61673) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:55:23 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-d8ebdb1c-085e-4c1c-9c0f-429b14309b72 req-e8ac3171-89d1-4039-9327-94fe39922a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab14831-868c-40aa-b694-9e0185557653", "name": "network-vif-unplugged", "status": "completed", "tag": "00582309-5b1a-4a4d-80b2-478c8f9ada29"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:23 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Flavor limits 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:55:23 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Image limits 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:55:23 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Flavor pref 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:55:23 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Image pref 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:55:23 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:55:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-d8ebdb1c-085e-4c1c-9c0f-429b14309b72 req-e8ac3171-89d1-4039-9327-94fe39922a61 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-d8ebdb1c-085e-4c1c-9c0f-429b14309b72 req-e8ac3171-89d1-4039-9327-94fe39922a61 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-d8ebdb1c-085e-4c1c-9c0f-429b14309b72 req-e8ac3171-89d1-4039-9327-94fe39922a61 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:23 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-d8ebdb1c-085e-4c1c-9c0f-429b14309b72 req-e8ac3171-89d1-4039-9327-94fe39922a61 service nova] Creating event network-vif-unplugged:00582309-5b1a-4a4d-80b2-478c8f9ada29 for instance cab14831-868c-40aa-b694-9e0185557653 on user Apr 14 18:55:23 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-d8ebdb1c-085e-4c1c-9c0f-429b14309b72 req-e8ac3171-89d1-4039-9327-94fe39922a61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038294 Apr 14 18:55:23 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 186/555] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:55:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:55:23 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Getting quotas for project 921435d84194431c886ec1ed1848d4d6. Resources: {'ram', 'instances', 'cores'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:55:23 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Getting quotas for user 9a9414d0c24643fdb162aad828c736bd and project 921435d84194431c886ec1ed1848d4d6. Resources: {'ram', 'instances', 'cores'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:55:23 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Going to run 1 instances... {{(pid=61673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:55:23 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:55:23 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.941934 Apr 14 18:55:23 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 183/556] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:55:22 2023] POST /compute/v2.1/servers => generated 404 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:55:23 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-a484c9b6-14cd-483d-bad2-05326d5d7f14 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:55:23 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-a484c9b6-14cd-483d-bad2-05326d5d7f14 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:55:23 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-a484c9b6-14cd-483d-bad2-05326d5d7f14 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a9414d0c24643fdb162aad828c736bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921435d84194431c886ec1ed1848d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:55:23 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-a484c9b6-14cd-483d-bad2-05326d5d7f14 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1feb4399-a5dc-43a7-ac78-4d22809e2737" status: 200 len: 1236 microversion: 2.1 time: 0.122327 Apr 14 18:55:23 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 188/557] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:55:23 2023] GET /compute/v2.1/servers/1feb4399-a5dc-43a7-ac78-4d22809e2737 => generated 1236 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:55:24 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-346421927", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "networks": [{"uuid": "7c02047b-1b40-4937-ac05-13accc969b21"}]}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:24 user devstack@n-api.service[61675]: DEBUG nova.network.neutron [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] validate_networks() for [('7c02047b-1b40-4937-ac05-13accc969b21', None, None, None, None, None)] {{(pid=61675) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:55:25 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-ac8d2889-a4ab-4063-976f-9fb74716a17b req-83c2df61-3b3e-414d-8587-c83bf6d3f741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab14831-868c-40aa-b694-9e0185557653", "name": "network-vif-plugged", "status": "completed", "tag": "00582309-5b1a-4a4d-80b2-478c8f9ada29"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-ac8d2889-a4ab-4063-976f-9fb74716a17b req-83c2df61-3b3e-414d-8587-c83bf6d3f741 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-ac8d2889-a4ab-4063-976f-9fb74716a17b req-83c2df61-3b3e-414d-8587-c83bf6d3f741 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-ac8d2889-a4ab-4063-976f-9fb74716a17b req-83c2df61-3b3e-414d-8587-c83bf6d3f741 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:25 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-ac8d2889-a4ab-4063-976f-9fb74716a17b req-83c2df61-3b3e-414d-8587-c83bf6d3f741 service nova] Creating event network-vif-plugged:00582309-5b1a-4a4d-80b2-478c8f9ada29 for instance cab14831-868c-40aa-b694-9e0185557653 on user Apr 14 18:55:25 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-ac8d2889-a4ab-4063-976f-9fb74716a17b req-83c2df61-3b3e-414d-8587-c83bf6d3f741 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039972 Apr 14 18:55:25 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 184/558] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:55:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 18:55:25 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:25 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-98b7ae34-279b-4239-99d2-f204ac87ec7a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:55:25 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-98b7ae34-279b-4239-99d2-f204ac87ec7a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:55:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-98b7ae34-279b-4239-99d2-f204ac87ec7a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-98b7ae34-279b-4239-99d2-f204ac87ec7a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-98b7ae34-279b-4239-99d2-f204ac87ec7a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-98b7ae34-279b-4239-99d2-f204ac87ec7a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-98b7ae34-279b-4239-99d2-f204ac87ec7a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-98b7ae34-279b-4239-99d2-f204ac87ec7a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:25 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Flavor limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:55:25 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Image limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:55:25 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Flavor pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:55:25 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Image pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:55:25 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:55:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:25 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Going to try to start instance {{(pid=61674) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 14 18:55:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:25 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Getting quotas for project 4af68184e7654efea3187e05bb10e5e4. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:55:25 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/action" status: 202 len: 0 microversion: 2.1 time: 0.181676 Apr 14 18:55:25 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 189/559] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 18:55:25 2023] POST /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:55:25 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Getting quotas for user 008a24026e844252b0be1268461bc2b1 and project 4af68184e7654efea3187e05bb10e5e4. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:55:25 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-701f5fd1-a4e9-47c7-8903-19ec8b332f4b tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:55:25 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-701f5fd1-a4e9-47c7-8903-19ec8b332f4b tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:55:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-701f5fd1-a4e9-47c7-8903-19ec8b332f4b tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-701f5fd1-a4e9-47c7-8903-19ec8b332f4b tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-701f5fd1-a4e9-47c7-8903-19ec8b332f4b tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:25 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Going to run 1 instances... {{(pid=61675) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:55:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-701f5fd1-a4e9-47c7-8903-19ec8b332f4b tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-701f5fd1-a4e9-47c7-8903-19ec8b332f4b tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-701f5fd1-a4e9-47c7-8903-19ec8b332f4b tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:25 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:55:25 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.928877 Apr 14 18:55:25 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 187/560] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:55:24 2023] POST /compute/v2.1/servers => generated 378 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:55:25 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-a5bec9dc-f1c2-4bc0-8783-ae88f3fa4b11 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:55:25 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-a5bec9dc-f1c2-4bc0-8783-ae88f3fa4b11 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:55:25 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-a5bec9dc-f1c2-4bc0-8783-ae88f3fa4b11 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008a24026e844252b0be1268461bc2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af68184e7654efea3187e05bb10e5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:55:25 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-a5bec9dc-f1c2-4bc0-8783-ae88f3fa4b11 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8832a321-f1ac-411a-8fc9-1fc816bffec6" status: 200 len: 1210 microversion: 2.1 time: 0.117294 Apr 14 18:55:25 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 188/561] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:55:25 2023] GET /compute/v2.1/servers/8832a321-f1ac-411a-8fc9-1fc816bffec6 => generated 1210 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 18:55:25 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-701f5fd1-a4e9-47c7-8903-19ec8b332f4b tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f90c8f23e3b42a98fdb9261db65f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf25bcc0dea4d3eb1284e8995eb3466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:55:25 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-701f5fd1-a4e9-47c7-8903-19ec8b332f4b tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4" status: 200 len: 1698 microversion: 2.1 time: 0.317542 Apr 14 18:55:25 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 190/562] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:55:25 2023] GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4 => generated 1698 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 18:55:26 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-98b7ae34-279b-4239-99d2-f204ac87ec7a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:55:26 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-98b7ae34-279b-4239-99d2-f204ac87ec7a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:55:26 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-98b7ae34-279b-4239-99d2-f204ac87ec7a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:55:26 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-98b7ae34-279b-4239-99d2-f204ac87ec7a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e79e2cb-54c5-487e-b852-49303ee3e3cc" status: 200 len: 1689 microversion: 2.87 time: 0.526876 Apr 14 18:55:26 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 185/563] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:55:25 2023] GET /compute/v2.1/servers/6e79e2cb-54c5-487e-b852-49303ee3e3cc => generated 1689 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:55:27 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-2420df51-8c06-48d9-bdb5-47740591e722 req-8710a300-0f74-4485-81dc-01a639468aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab14831-868c-40aa-b694-9e0185557653", "name": "network-vif-plugged", "status": "completed", "tag": "00582309-5b1a-4a4d-80b2-478c8f9ada29"}, {"server_uuid": "cab14831-868c-40aa-b694-9e0185557653", "name": "network-vif-plugged", "status": "completed", "tag": "00582309-5b1a-4a4d-80b2-478c8f9ada29"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:27 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-2420df51-8c06-48d9-bdb5-47740591e722 req-8710a300-0f74-4485-81dc-01a639468aa1 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:27 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-2420df51-8c06-48d9-bdb5-47740591e722 req-8710a300-0f74-4485-81dc-01a639468aa1 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:27 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-2420df51-8c06-48d9-bdb5-47740591e722 req-8710a300-0f74-4485-81dc-01a639468aa1 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:27 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-2420df51-8c06-48d9-bdb5-47740591e722 req-8710a300-0f74-4485-81dc-01a639468aa1 service nova] Creating event network-vif-plugged:00582309-5b1a-4a4d-80b2-478c8f9ada29 for instance cab14831-868c-40aa-b694-9e0185557653 on user Apr 14 18:55:27 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-2420df51-8c06-48d9-bdb5-47740591e722 req-8710a300-0f74-4485-81dc-01a639468aa1 service nova] Creating event network-vif-plugged:00582309-5b1a-4a4d-80b2-478c8f9ada29 for instance cab14831-868c-40aa-b694-9e0185557653 on user Apr 14 18:55:27 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-2420df51-8c06-48d9-bdb5-47740591e722 req-8710a300-0f74-4485-81dc-01a639468aa1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041760 Apr 14 18:55:27 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 189/564] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:55:27 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:55:29 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-ce6a9714-047c-4db2-a441-918188ef4ecc req-ca99f5e4-05ce-438f-a9a0-3f0666f8d45e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1feb4399-a5dc-43a7-ac78-4d22809e2737", "tag": "99fafc78-521b-4f9c-81fe-9571483238c1"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-ce6a9714-047c-4db2-a441-918188ef4ecc req-ca99f5e4-05ce-438f-a9a0-3f0666f8d45e service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-ce6a9714-047c-4db2-a441-918188ef4ecc req-ca99f5e4-05ce-438f-a9a0-3f0666f8d45e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-ce6a9714-047c-4db2-a441-918188ef4ecc req-ca99f5e4-05ce-438f-a9a0-3f0666f8d45e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:29 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-ce6a9714-047c-4db2-a441-918188ef4ecc req-ca99f5e4-05ce-438f-a9a0-3f0666f8d45e service nova] Creating event network-changed:99fafc78-521b-4f9c-81fe-9571483238c1 for instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 on user Apr 14 18:55:29 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-ce6a9714-047c-4db2-a441-918188ef4ecc req-ca99f5e4-05ce-438f-a9a0-3f0666f8d45e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059021 Apr 14 18:55:29 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 191/565] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:55:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:55:31 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-b5bd8919-91b5-40d2-b956-f0b8b9821d26 req-72a7f307-727d-470a-a799-feee0853e33d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8832a321-f1ac-411a-8fc9-1fc816bffec6", "tag": "e4886e4d-4e50-4de8-93e6-61be10466add"}, {"server_uuid": "1feb4399-a5dc-43a7-ac78-4d22809e2737", "name": "network-vif-plugged", "status": "completed", "tag": "99fafc78-521b-4f9c-81fe-9571483238c1"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-b5bd8919-91b5-40d2-b956-f0b8b9821d26 req-72a7f307-727d-470a-a799-feee0853e33d service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-b5bd8919-91b5-40d2-b956-f0b8b9821d26 req-72a7f307-727d-470a-a799-feee0853e33d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-b5bd8919-91b5-40d2-b956-f0b8b9821d26 req-72a7f307-727d-470a-a799-feee0853e33d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:31 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-b5bd8919-91b5-40d2-b956-f0b8b9821d26 req-72a7f307-727d-470a-a799-feee0853e33d service nova] Creating event network-changed:e4886e4d-4e50-4de8-93e6-61be10466add for instance 8832a321-f1ac-411a-8fc9-1fc816bffec6 on user Apr 14 18:55:31 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-b5bd8919-91b5-40d2-b956-f0b8b9821d26 req-72a7f307-727d-470a-a799-feee0853e33d service nova] Creating event network-vif-plugged:99fafc78-521b-4f9c-81fe-9571483238c1 for instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 on user Apr 14 18:55:31 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-b5bd8919-91b5-40d2-b956-f0b8b9821d26 req-72a7f307-727d-470a-a799-feee0853e33d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.055652 Apr 14 18:55:31 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 186/566] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:55:31 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:55:32 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:32 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:55:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:32 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-8463c6c0-2ae1-4099-b0ac-4d0c02478cff req-6cbe8eb7-f8d0-449b-aca5-713956da339c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0050e6bb-0b53-4fdc-8437-16b94ee79fa4", "name": "network-vif-plugged", "status": "completed", "tag": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:32 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-8463c6c0-2ae1-4099-b0ac-4d0c02478cff req-6cbe8eb7-f8d0-449b-aca5-713956da339c service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:32 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-8463c6c0-2ae1-4099-b0ac-4d0c02478cff req-6cbe8eb7-f8d0-449b-aca5-713956da339c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:32 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-8463c6c0-2ae1-4099-b0ac-4d0c02478cff req-6cbe8eb7-f8d0-449b-aca5-713956da339c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:32 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-8463c6c0-2ae1-4099-b0ac-4d0c02478cff req-6cbe8eb7-f8d0-449b-aca5-713956da339c service nova] Creating event network-vif-plugged:2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 on user Apr 14 18:55:32 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-8463c6c0-2ae1-4099-b0ac-4d0c02478cff req-6cbe8eb7-f8d0-449b-aca5-713956da339c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035906 Apr 14 18:55:32 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 192/567] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:55:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 18:55:32 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61675) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 18:55:32 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a2a860bd-802f-4760-b77b-92b7ac4ad09b/action" status: 202 len: 0 microversion: 2.1 time: 0.285377 Apr 14 18:55:32 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 190/568] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 18:55:32 2023] POST /compute/v2.1/servers/a2a860bd-802f-4760-b77b-92b7ac4ad09b/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:55:32 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-51c0974a-c473-4da1-9f8b-491c8981847d tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:55:32 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-51c0974a-c473-4da1-9f8b-491c8981847d tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:55:32 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:55:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-51c0974a-c473-4da1-9f8b-491c8981847d tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-51c0974a-c473-4da1-9f8b-491c8981847d tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-51c0974a-c473-4da1-9f8b-491c8981847d tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-51c0974a-c473-4da1-9f8b-491c8981847d tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-51c0974a-c473-4da1-9f8b-491c8981847d tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-51c0974a-c473-4da1-9f8b-491c8981847d tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:32 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:55:33 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:55:33 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=10 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:55:33 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-51c0974a-c473-4da1-9f8b-491c8981847d tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e3f2dda9bc49f48c66beb978dbdaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0091007734312b8d33caf294d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:55:33 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-51c0974a-c473-4da1-9f8b-491c8981847d tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2a860bd-802f-4760-b77b-92b7ac4ad09b" status: 200 len: 1506 microversion: 2.1 time: 0.762864 Apr 14 18:55:33 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 187/569] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:55:32 2023] GET /compute/v2.1/servers/a2a860bd-802f-4760-b77b-92b7ac4ad09b => generated 1506 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:55:33 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:55:33 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-63b4b5a1-6df0-45a5-8c5d-7df43e148185 req-1f01585d-54fd-4e13-967b-e833e8aec198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1feb4399-a5dc-43a7-ac78-4d22809e2737", "name": "network-vif-plugged", "status": "completed", "tag": "99fafc78-521b-4f9c-81fe-9571483238c1"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:33 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=25 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:55:33 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-63b4b5a1-6df0-45a5-8c5d-7df43e148185 req-1f01585d-54fd-4e13-967b-e833e8aec198 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:33 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-63b4b5a1-6df0-45a5-8c5d-7df43e148185 req-1f01585d-54fd-4e13-967b-e833e8aec198 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:33 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-63b4b5a1-6df0-45a5-8c5d-7df43e148185 req-1f01585d-54fd-4e13-967b-e833e8aec198 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:33 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:55:33 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-63b4b5a1-6df0-45a5-8c5d-7df43e148185 req-1f01585d-54fd-4e13-967b-e833e8aec198 service nova] Creating event network-vif-plugged:99fafc78-521b-4f9c-81fe-9571483238c1 for instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 on user Apr 14 18:55:33 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-63b4b5a1-6df0-45a5-8c5d-7df43e148185 req-1f01585d-54fd-4e13-967b-e833e8aec198 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038424 Apr 14 18:55:33 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 193/570] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:55:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:55:34 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-248b781f-89e7-4b0c-816d-94100082d0ae req-bd66cbed-8be4-4ba0-8a32-8666298537a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0050e6bb-0b53-4fdc-8437-16b94ee79fa4", "name": "network-vif-plugged", "status": "completed", "tag": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21"}, {"server_uuid": "8832a321-f1ac-411a-8fc9-1fc816bffec6", "name": "network-vif-plugged", "status": "completed", "tag": "e4886e4d-4e50-4de8-93e6-61be10466add"}, {"server_uuid": "8832a321-f1ac-411a-8fc9-1fc816bffec6", "name": "network-vif-plugged", "status": "completed", "tag": "e4886e4d-4e50-4de8-93e6-61be10466add"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:34 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:55:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-248b781f-89e7-4b0c-816d-94100082d0ae req-bd66cbed-8be4-4ba0-8a32-8666298537a4 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-248b781f-89e7-4b0c-816d-94100082d0ae req-bd66cbed-8be4-4ba0-8a32-8666298537a4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-248b781f-89e7-4b0c-816d-94100082d0ae req-bd66cbed-8be4-4ba0-8a32-8666298537a4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:34 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:55:34 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-248b781f-89e7-4b0c-816d-94100082d0ae req-bd66cbed-8be4-4ba0-8a32-8666298537a4 service nova] Creating event network-vif-plugged:2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 on user Apr 14 18:55:34 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-248b781f-89e7-4b0c-816d-94100082d0ae req-bd66cbed-8be4-4ba0-8a32-8666298537a4 service nova] Creating event network-vif-plugged:e4886e4d-4e50-4de8-93e6-61be10466add for instance 8832a321-f1ac-411a-8fc9-1fc816bffec6 on user Apr 14 18:55:34 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-248b781f-89e7-4b0c-816d-94100082d0ae req-bd66cbed-8be4-4ba0-8a32-8666298537a4 service nova] Creating event network-vif-plugged:e4886e4d-4e50-4de8-93e6-61be10466add for instance 8832a321-f1ac-411a-8fc9-1fc816bffec6 on user Apr 14 18:55:34 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-248b781f-89e7-4b0c-816d-94100082d0ae req-bd66cbed-8be4-4ba0-8a32-8666298537a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.050104 Apr 14 18:55:34 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 191/571] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:55:34 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:55:39 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-2c4c781a-3aed-45c4-945b-cb14ee4205f0 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:55:39 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-2c4c781a-3aed-45c4-945b-cb14ee4205f0 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:55:39 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2c4c781a-3aed-45c4-945b-cb14ee4205f0 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:39 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2c4c781a-3aed-45c4-945b-cb14ee4205f0 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:39 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2c4c781a-3aed-45c4-945b-cb14ee4205f0 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:39 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2c4c781a-3aed-45c4-945b-cb14ee4205f0 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:39 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2c4c781a-3aed-45c4-945b-cb14ee4205f0 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:39 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2c4c781a-3aed-45c4-945b-cb14ee4205f0 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:39 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-2c4c781a-3aed-45c4-945b-cb14ee4205f0 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055181 Apr 14 18:55:39 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 188/572] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:55:39 2023] GET /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 18:55:39 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:55:39 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:55:39 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:39 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:39 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:39 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:39 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:39 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:39 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Going to try to terminate instance {{(pid=61674) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 18:55:40 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38" status: 204 len: 0 microversion: 2.1 time: 0.178310 Apr 14 18:55:40 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 194/573] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 18:55:39 2023] DELETE /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 18:55:40 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:55:40 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=8 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:55:40 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-b3d376a0-e27f-4883-a099-64ec9b4885f6 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:55:40 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-b3d376a0-e27f-4883-a099-64ec9b4885f6 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:55:40 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b3d376a0-e27f-4883-a099-64ec9b4885f6 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:40 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b3d376a0-e27f-4883-a099-64ec9b4885f6 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:40 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b3d376a0-e27f-4883-a099-64ec9b4885f6 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:40 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b3d376a0-e27f-4883-a099-64ec9b4885f6 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:40 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b3d376a0-e27f-4883-a099-64ec9b4885f6 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:40 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b3d376a0-e27f-4883-a099-64ec9b4885f6 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:40 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-cbd4cc27-f13c-4124-95fd-9d7072211d81 req-eec8d95b-6a48-4882-9f9f-8384d8890042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61944d61-738b-42a7-a95d-8caa6fa29a38", "name": "network-vif-unplugged", "status": "completed", "tag": "62d648bd-cf77-401d-abcf-b4f95e339dc9"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:40 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-cbd4cc27-f13c-4124-95fd-9d7072211d81 req-eec8d95b-6a48-4882-9f9f-8384d8890042 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:40 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-cbd4cc27-f13c-4124-95fd-9d7072211d81 req-eec8d95b-6a48-4882-9f9f-8384d8890042 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:40 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-cbd4cc27-f13c-4124-95fd-9d7072211d81 req-eec8d95b-6a48-4882-9f9f-8384d8890042 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:40 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-cbd4cc27-f13c-4124-95fd-9d7072211d81 req-eec8d95b-6a48-4882-9f9f-8384d8890042 service nova] Creating event network-vif-unplugged:62d648bd-cf77-401d-abcf-b4f95e339dc9 for instance 61944d61-738b-42a7-a95d-8caa6fa29a38 on user Apr 14 18:55:40 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-cbd4cc27-f13c-4124-95fd-9d7072211d81 req-eec8d95b-6a48-4882-9f9f-8384d8890042 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130554 Apr 14 18:55:40 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 189/574] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:55:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:55:40 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-b3d376a0-e27f-4883-a099-64ec9b4885f6 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d53edaffb8f4038abd366d7942c6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34cdebcd7154988a957deae140e8eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:55:40 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-b3d376a0-e27f-4883-a099-64ec9b4885f6 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38" status: 200 len: 1668 microversion: 2.1 time: 0.900542 Apr 14 18:55:40 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 192/575] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:55:40 2023] GET /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38 => generated 1668 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:55:42 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-08d29349-3fc0-42b9-a5bc-34350c9fbb0c req-3aa0e127-5e39-45fd-adab-367f1360d8fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61944d61-738b-42a7-a95d-8caa6fa29a38", "name": "network-vif-plugged", "status": "completed", "tag": "62d648bd-cf77-401d-abcf-b4f95e339dc9"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-08d29349-3fc0-42b9-a5bc-34350c9fbb0c req-3aa0e127-5e39-45fd-adab-367f1360d8fa service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-08d29349-3fc0-42b9-a5bc-34350c9fbb0c req-3aa0e127-5e39-45fd-adab-367f1360d8fa service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-08d29349-3fc0-42b9-a5bc-34350c9fbb0c req-3aa0e127-5e39-45fd-adab-367f1360d8fa service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:42 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-08d29349-3fc0-42b9-a5bc-34350c9fbb0c req-3aa0e127-5e39-45fd-adab-367f1360d8fa service nova] Creating event network-vif-plugged:62d648bd-cf77-401d-abcf-b4f95e339dc9 for instance 61944d61-738b-42a7-a95d-8caa6fa29a38 on user Apr 14 18:55:42 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-08d29349-3fc0-42b9-a5bc-34350c9fbb0c req-3aa0e127-5e39-45fd-adab-367f1360d8fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034671 Apr 14 18:55:42 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 195/576] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:55:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 18:55:42 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-386212ca-8fec-449c-a7fd-ab4c457d9d6b req-64605975-d849-47e0-a22e-0391213d4257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61944d61-738b-42a7-a95d-8caa6fa29a38", "name": "network-vif-deleted", "tag": "62d648bd-cf77-401d-abcf-b4f95e339dc9"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-386212ca-8fec-449c-a7fd-ab4c457d9d6b req-64605975-d849-47e0-a22e-0391213d4257 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-386212ca-8fec-449c-a7fd-ab4c457d9d6b req-64605975-d849-47e0-a22e-0391213d4257 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-386212ca-8fec-449c-a7fd-ab4c457d9d6b req-64605975-d849-47e0-a22e-0391213d4257 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:42 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-386212ca-8fec-449c-a7fd-ab4c457d9d6b req-64605975-d849-47e0-a22e-0391213d4257 service nova] Creating event network-vif-deleted:62d648bd-cf77-401d-abcf-b4f95e339dc9 for instance 61944d61-738b-42a7-a95d-8caa6fa29a38 on user Apr 14 18:55:42 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-386212ca-8fec-449c-a7fd-ab4c457d9d6b req-64605975-d849-47e0-a22e-0391213d4257 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032877 Apr 14 18:55:42 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 190/577] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:55:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:55:45 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-f8b7395a-0e98-436f-b937-182ad8d75736 req-ca4c7e31-dfb8-496e-937c-210f54e05fea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a860bd-802f-4760-b77b-92b7ac4ad09b", "tag": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:45 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-f8b7395a-0e98-436f-b937-182ad8d75736 req-ca4c7e31-dfb8-496e-937c-210f54e05fea service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:45 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-f8b7395a-0e98-436f-b937-182ad8d75736 req-ca4c7e31-dfb8-496e-937c-210f54e05fea service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:45 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-f8b7395a-0e98-436f-b937-182ad8d75736 req-ca4c7e31-dfb8-496e-937c-210f54e05fea service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:45 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-f8b7395a-0e98-436f-b937-182ad8d75736 req-ca4c7e31-dfb8-496e-937c-210f54e05fea service nova] Creating event network-changed:ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 for instance a2a860bd-802f-4760-b77b-92b7ac4ad09b on user Apr 14 18:55:45 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-f8b7395a-0e98-436f-b937-182ad8d75736 req-ca4c7e31-dfb8-496e-937c-210f54e05fea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027731 Apr 14 18:55:45 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 193/578] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:55:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:55:47 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-84429ca3-4753-4cf5-914f-f8c3869bf1b3 req-c6e5b25b-f1c4-4827-a8e7-cf90670e96d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a860bd-802f-4760-b77b-92b7ac4ad09b", "name": "network-vif-plugged", "status": "completed", "tag": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-84429ca3-4753-4cf5-914f-f8c3869bf1b3 req-c6e5b25b-f1c4-4827-a8e7-cf90670e96d1 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-84429ca3-4753-4cf5-914f-f8c3869bf1b3 req-c6e5b25b-f1c4-4827-a8e7-cf90670e96d1 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-84429ca3-4753-4cf5-914f-f8c3869bf1b3 req-c6e5b25b-f1c4-4827-a8e7-cf90670e96d1 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:47 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-84429ca3-4753-4cf5-914f-f8c3869bf1b3 req-c6e5b25b-f1c4-4827-a8e7-cf90670e96d1 service nova] Creating event network-vif-plugged:ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 for instance a2a860bd-802f-4760-b77b-92b7ac4ad09b on user Apr 14 18:55:47 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-84429ca3-4753-4cf5-914f-f8c3869bf1b3 req-c6e5b25b-f1c4-4827-a8e7-cf90670e96d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046500 Apr 14 18:55:47 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 196/579] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:55:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:55:49 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-63cf5580-ab56-4ae5-a189-0050fe9d02ba req-2921e267-9171-4baf-a350-81b94587e045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a860bd-802f-4760-b77b-92b7ac4ad09b", "name": "network-vif-plugged", "status": "completed", "tag": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:49 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-63cf5580-ab56-4ae5-a189-0050fe9d02ba req-2921e267-9171-4baf-a350-81b94587e045 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:49 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-63cf5580-ab56-4ae5-a189-0050fe9d02ba req-2921e267-9171-4baf-a350-81b94587e045 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:49 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-63cf5580-ab56-4ae5-a189-0050fe9d02ba req-2921e267-9171-4baf-a350-81b94587e045 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:49 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-63cf5580-ab56-4ae5-a189-0050fe9d02ba req-2921e267-9171-4baf-a350-81b94587e045 service nova] Creating event network-vif-plugged:ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 for instance a2a860bd-802f-4760-b77b-92b7ac4ad09b on user Apr 14 18:55:49 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-63cf5580-ab56-4ae5-a189-0050fe9d02ba req-2921e267-9171-4baf-a350-81b94587e045 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032183 Apr 14 18:55:49 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 191/580] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:55:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:55:50 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1420304723", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "a6397e02-c899-47bd-8f26-696ca228bc26", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70"}]}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:50 user devstack@n-api.service[61675]: DEBUG nova.network.neutron [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] validate_networks() for [('bfa4fdbb-10b3-4715-9ff2-b717d052cc70', None, None, None, None, None)] {{(pid=61675) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:55:51 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flavor limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:55:51 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Image limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:55:51 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flavor pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:55:51 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Image pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:55:51 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:55:51 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:51 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:51 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:51 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:51 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:51 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:51 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Getting quotas for project 72d2bf68325a4a18934a8403571c24bb. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:55:51 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Getting quotas for user fc3bed70703a49c8bdec2f50193c7f70 and project 72d2bf68325a4a18934a8403571c24bb. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:55:51 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Going to run 1 instances... {{(pid=61675) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:55:51 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='a6397e02-c899-47bd-8f26-696ca228bc26',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:55:51 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.718952 Apr 14 18:55:51 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 194/581] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:55:50 2023] POST /compute/v2.1/servers => generated 378 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:55:51 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-84f64d73-c297-47eb-a2a5-0a6388c2d3bc tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:55:51 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-84f64d73-c297-47eb-a2a5-0a6388c2d3bc tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:55:51 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-84f64d73-c297-47eb-a2a5-0a6388c2d3bc tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:55:51 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-84f64d73-c297-47eb-a2a5-0a6388c2d3bc tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc9e21d7-f70e-41ea-8ab1-9014f93ad508" status: 200 len: 1052 microversion: 2.1 time: 0.067302 Apr 14 18:55:51 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 197/582] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:55:51 2023] GET /compute/v2.1/servers/bc9e21d7-f70e-41ea-8ab1-9014f93ad508 => generated 1052 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:55:54 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-29ee6885-6396-49c0-82c7-551debf44530 req-9dd6b14e-c964-453b-b668-6ed832191950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc9e21d7-f70e-41ea-8ab1-9014f93ad508", "tag": "62e9aa7c-0fd9-4498-9592-9bff455b6bbf"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:55:54 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-29ee6885-6396-49c0-82c7-551debf44530 req-9dd6b14e-c964-453b-b668-6ed832191950 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:54 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-29ee6885-6396-49c0-82c7-551debf44530 req-9dd6b14e-c964-453b-b668-6ed832191950 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:54 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-29ee6885-6396-49c0-82c7-551debf44530 req-9dd6b14e-c964-453b-b668-6ed832191950 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:54 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-29ee6885-6396-49c0-82c7-551debf44530 req-9dd6b14e-c964-453b-b668-6ed832191950 service nova] Creating event network-changed:62e9aa7c-0fd9-4498-9592-9bff455b6bbf for instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508 on user Apr 14 18:55:54 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-29ee6885-6396-49c0-82c7-551debf44530 req-9dd6b14e-c964-453b-b668-6ed832191950 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028442 Apr 14 18:55:54 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 192/583] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:55:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:55:59 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-80cc1200-b59c-4e7f-a0cf-2273b0a32769 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:55:59 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-80cc1200-b59c-4e7f-a0cf-2273b0a32769 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:55:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-80cc1200-b59c-4e7f-a0cf-2273b0a32769 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-80cc1200-b59c-4e7f-a0cf-2273b0a32769 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-80cc1200-b59c-4e7f-a0cf-2273b0a32769 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:55:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-80cc1200-b59c-4e7f-a0cf-2273b0a32769 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:55:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-80cc1200-b59c-4e7f-a0cf-2273b0a32769 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:55:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-80cc1200-b59c-4e7f-a0cf-2273b0a32769 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:00 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-80cc1200-b59c-4e7f-a0cf-2273b0a32769 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8713ed85ffb4446847f5ded4bc2e399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60e8abd123e414f847c68ba72894689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:56:00 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-80cc1200-b59c-4e7f-a0cf-2273b0a32769 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d305ab4-1813-4728-a01c-287e521a05ec" status: 200 len: 1490 microversion: 2.1 time: 0.891268 Apr 14 18:56:00 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 195/584] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:55:59 2023] GET /compute/v2.1/servers/1d305ab4-1813-4728-a01c-287e521a05ec => generated 1490 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:56:06 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-5511c629-3020-459b-871d-44764b1236a8 req-067819fc-b46a-4dcf-b14e-e35647d1b619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc9e21d7-f70e-41ea-8ab1-9014f93ad508", "name": "network-vif-plugged", "status": "completed", "tag": "62e9aa7c-0fd9-4498-9592-9bff455b6bbf"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:56:06 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:56:06 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:56:06 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:56:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-5511c629-3020-459b-871d-44764b1236a8 req-067819fc-b46a-4dcf-b14e-e35647d1b619 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-5511c629-3020-459b-871d-44764b1236a8 req-067819fc-b46a-4dcf-b14e-e35647d1b619 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-5511c629-3020-459b-871d-44764b1236a8 req-067819fc-b46a-4dcf-b14e-e35647d1b619 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:06 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-5511c629-3020-459b-871d-44764b1236a8 req-067819fc-b46a-4dcf-b14e-e35647d1b619 service nova] Creating event network-vif-plugged:62e9aa7c-0fd9-4498-9592-9bff455b6bbf for instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508 on user Apr 14 18:56:06 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-5511c629-3020-459b-871d-44764b1236a8 req-067819fc-b46a-4dcf-b14e-e35647d1b619 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052420 Apr 14 18:56:06 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 198/585] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:56:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:56:08 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=11 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:56:08 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=19 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:56:08 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-6f4e4acc-310f-459c-b624-e00016c3cb81 req-82f91ec9-0016-46a9-8903-0b07cc35fb94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc9e21d7-f70e-41ea-8ab1-9014f93ad508", "name": "network-vif-plugged", "status": "completed", "tag": "62e9aa7c-0fd9-4498-9592-9bff455b6bbf"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:56:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-6f4e4acc-310f-459c-b624-e00016c3cb81 req-82f91ec9-0016-46a9-8903-0b07cc35fb94 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-6f4e4acc-310f-459c-b624-e00016c3cb81 req-82f91ec9-0016-46a9-8903-0b07cc35fb94 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-6f4e4acc-310f-459c-b624-e00016c3cb81 req-82f91ec9-0016-46a9-8903-0b07cc35fb94 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:08 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-6f4e4acc-310f-459c-b624-e00016c3cb81 req-82f91ec9-0016-46a9-8903-0b07cc35fb94 service nova] Creating event network-vif-plugged:62e9aa7c-0fd9-4498-9592-9bff455b6bbf for instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508 on user Apr 14 18:56:08 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-6f4e4acc-310f-459c-b624-e00016c3cb81 req-82f91ec9-0016-46a9-8903-0b07cc35fb94 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042018 Apr 14 18:56:08 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 193/586] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:56:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 18:56:08 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:56:08 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:56:08 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:56:08 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=6 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:56:08 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:56:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:08 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "POST /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be/action" status: 202 len: 0 microversion: 2.1 time: 0.184106 Apr 14 18:56:08 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 196/587] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 18:56:08 2023] POST /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:56:08 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-b1d3e350-87bc-461d-8de2-3c962db1c08f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:56:08 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-b1d3e350-87bc-461d-8de2-3c962db1c08f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:56:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b1d3e350-87bc-461d-8de2-3c962db1c08f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b1d3e350-87bc-461d-8de2-3c962db1c08f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b1d3e350-87bc-461d-8de2-3c962db1c08f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b1d3e350-87bc-461d-8de2-3c962db1c08f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b1d3e350-87bc-461d-8de2-3c962db1c08f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b1d3e350-87bc-461d-8de2-3c962db1c08f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:08 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-b1d3e350-87bc-461d-8de2-3c962db1c08f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:56:08 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-b1d3e350-87bc-461d-8de2-3c962db1c08f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 200 len: 1728 microversion: 2.1 time: 0.242886 Apr 14 18:56:08 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 199/588] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:56:08 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 1728 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:56:10 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-fcf83074-c8c7-44fb-bda1-d56637d63bdd req-80cf37e3-e78b-43ce-8f36-05c479280d1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa09363f-435d-4fa8-9f11-db0c3f4e08be", "name": "network-vif-unplugged", "status": "completed", "tag": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:56:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-fcf83074-c8c7-44fb-bda1-d56637d63bdd req-80cf37e3-e78b-43ce-8f36-05c479280d1e service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-fcf83074-c8c7-44fb-bda1-d56637d63bdd req-80cf37e3-e78b-43ce-8f36-05c479280d1e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-fcf83074-c8c7-44fb-bda1-d56637d63bdd req-80cf37e3-e78b-43ce-8f36-05c479280d1e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:10 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-fcf83074-c8c7-44fb-bda1-d56637d63bdd req-80cf37e3-e78b-43ce-8f36-05c479280d1e service nova] Creating event network-vif-unplugged:2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance aa09363f-435d-4fa8-9f11-db0c3f4e08be on user Apr 14 18:56:10 user devstack@n-api.service[61673]: DEBUG nova.compute.api [req-fcf83074-c8c7-44fb-bda1-d56637d63bdd req-80cf37e3-e78b-43ce-8f36-05c479280d1e service nova] Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61673) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 18:56:10 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-fcf83074-c8c7-44fb-bda1-d56637d63bdd req-80cf37e3-e78b-43ce-8f36-05c479280d1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051512 Apr 14 18:56:10 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 194/589] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:56:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:56:10 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-2dca0fb7-6cf4-4cfb-a00e-4dd632a14786 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:56:10 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-2dca0fb7-6cf4-4cfb-a00e-4dd632a14786 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:56:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2dca0fb7-6cf4-4cfb-a00e-4dd632a14786 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2dca0fb7-6cf4-4cfb-a00e-4dd632a14786 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2dca0fb7-6cf4-4cfb-a00e-4dd632a14786 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2dca0fb7-6cf4-4cfb-a00e-4dd632a14786 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2dca0fb7-6cf4-4cfb-a00e-4dd632a14786 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2dca0fb7-6cf4-4cfb-a00e-4dd632a14786 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:10 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:56:10 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-2dca0fb7-6cf4-4cfb-a00e-4dd632a14786 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e1d31c2d9048699758779dedf7d3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6b4e98cf9e4f96b79c3288dfe0da89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:56:10 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-2dca0fb7-6cf4-4cfb-a00e-4dd632a14786 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653" status: 200 len: 1748 microversion: 2.1 time: 0.333760 Apr 14 18:56:10 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 197/590] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:56:10 2023] GET /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653 => generated 1748 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:56:12 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-5fdb7bc3-8e43-4451-81c2-8b27b0869201 req-a44a2eb4-ee17-4efc-b63a-c4f21f4f9493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa09363f-435d-4fa8-9f11-db0c3f4e08be", "name": "network-vif-plugged", "status": "completed", "tag": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:56:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-5fdb7bc3-8e43-4451-81c2-8b27b0869201 req-a44a2eb4-ee17-4efc-b63a-c4f21f4f9493 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-5fdb7bc3-8e43-4451-81c2-8b27b0869201 req-a44a2eb4-ee17-4efc-b63a-c4f21f4f9493 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-5fdb7bc3-8e43-4451-81c2-8b27b0869201 req-a44a2eb4-ee17-4efc-b63a-c4f21f4f9493 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:12 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-5fdb7bc3-8e43-4451-81c2-8b27b0869201 req-a44a2eb4-ee17-4efc-b63a-c4f21f4f9493 service nova] Creating event network-vif-plugged:2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance aa09363f-435d-4fa8-9f11-db0c3f4e08be on user Apr 14 18:56:12 user devstack@n-api.service[61674]: DEBUG nova.compute.api [req-5fdb7bc3-8e43-4451-81c2-8b27b0869201 req-a44a2eb4-ee17-4efc-b63a-c4f21f4f9493 service nova] Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61674) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 18:56:12 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-5fdb7bc3-8e43-4451-81c2-8b27b0869201 req-a44a2eb4-ee17-4efc-b63a-c4f21f4f9493 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039738 Apr 14 18:56:12 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 200/591] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:56:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:56:13 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-43b9e162-a0d6-4657-901d-ef020de5223e tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:56:13 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-43b9e162-a0d6-4657-901d-ef020de5223e tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:56:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-43b9e162-a0d6-4657-901d-ef020de5223e tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-43b9e162-a0d6-4657-901d-ef020de5223e tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-43b9e162-a0d6-4657-901d-ef020de5223e tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-43b9e162-a0d6-4657-901d-ef020de5223e tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-43b9e162-a0d6-4657-901d-ef020de5223e tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-43b9e162-a0d6-4657-901d-ef020de5223e tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:13 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-43b9e162-a0d6-4657-901d-ef020de5223e tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a9414d0c24643fdb162aad828c736bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921435d84194431c886ec1ed1848d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:56:13 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-43b9e162-a0d6-4657-901d-ef020de5223e tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1feb4399-a5dc-43a7-ac78-4d22809e2737" status: 200 len: 1536 microversion: 2.1 time: 0.302788 Apr 14 18:56:13 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 195/592] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:56:13 2023] GET /compute/v2.1/servers/1feb4399-a5dc-43a7-ac78-4d22809e2737 => generated 1536 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:56:15 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-b4eccdb1-0546-4aa3-acc8-05796808db79 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:56:15 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-b4eccdb1-0546-4aa3-acc8-05796808db79 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:56:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b4eccdb1-0546-4aa3-acc8-05796808db79 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b4eccdb1-0546-4aa3-acc8-05796808db79 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b4eccdb1-0546-4aa3-acc8-05796808db79 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b4eccdb1-0546-4aa3-acc8-05796808db79 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b4eccdb1-0546-4aa3-acc8-05796808db79 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b4eccdb1-0546-4aa3-acc8-05796808db79 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:16 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-51881140-0158-4667-9ef6-70d431f31890 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:56:16 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-51881140-0158-4667-9ef6-70d431f31890 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:56:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-51881140-0158-4667-9ef6-70d431f31890 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-51881140-0158-4667-9ef6-70d431f31890 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-51881140-0158-4667-9ef6-70d431f31890 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-51881140-0158-4667-9ef6-70d431f31890 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-51881140-0158-4667-9ef6-70d431f31890 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-51881140-0158-4667-9ef6-70d431f31890 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:16 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-b4eccdb1-0546-4aa3-acc8-05796808db79 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008a24026e844252b0be1268461bc2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af68184e7654efea3187e05bb10e5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:56:16 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-b4eccdb1-0546-4aa3-acc8-05796808db79 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8832a321-f1ac-411a-8fc9-1fc816bffec6" status: 200 len: 1492 microversion: 2.1 time: 0.357666 Apr 14 18:56:16 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 198/593] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:56:15 2023] GET /compute/v2.1/servers/8832a321-f1ac-411a-8fc9-1fc816bffec6 => generated 1492 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:56:16 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-51881140-0158-4667-9ef6-70d431f31890 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f90c8f23e3b42a98fdb9261db65f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf25bcc0dea4d3eb1284e8995eb3466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:56:16 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-51881140-0158-4667-9ef6-70d431f31890 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4" status: 200 len: 1702 microversion: 2.1 time: 0.360030 Apr 14 18:56:16 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 201/594] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:56:16 2023] GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4 => generated 1702 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:56:22 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-1f41b573-b160-4614-82c1-5f424381f321 req-84f5a433-3681-4998-905d-f2cbf830ba8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa09363f-435d-4fa8-9f11-db0c3f4e08be", "name": "network-vif-plugged", "status": "completed", "tag": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:56:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-1f41b573-b160-4614-82c1-5f424381f321 req-84f5a433-3681-4998-905d-f2cbf830ba8b service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-1f41b573-b160-4614-82c1-5f424381f321 req-84f5a433-3681-4998-905d-f2cbf830ba8b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-1f41b573-b160-4614-82c1-5f424381f321 req-84f5a433-3681-4998-905d-f2cbf830ba8b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:22 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-1f41b573-b160-4614-82c1-5f424381f321 req-84f5a433-3681-4998-905d-f2cbf830ba8b service nova] Creating event network-vif-plugged:2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance aa09363f-435d-4fa8-9f11-db0c3f4e08be on user Apr 14 18:56:22 user devstack@n-api.service[61673]: DEBUG nova.compute.api [req-1f41b573-b160-4614-82c1-5f424381f321 req-84f5a433-3681-4998-905d-f2cbf830ba8b service nova] Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61673) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 18:56:22 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-1f41b573-b160-4614-82c1-5f424381f321 req-84f5a433-3681-4998-905d-f2cbf830ba8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128385 Apr 14 18:56:22 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 196/595] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:56:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:56:23 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-d561ba50-470b-473b-a21a-ab3b527a138c tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:56:23 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-d561ba50-470b-473b-a21a-ab3b527a138c tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:56:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d561ba50-470b-473b-a21a-ab3b527a138c tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d561ba50-470b-473b-a21a-ab3b527a138c tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d561ba50-470b-473b-a21a-ab3b527a138c tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d561ba50-470b-473b-a21a-ab3b527a138c tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d561ba50-470b-473b-a21a-ab3b527a138c tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d561ba50-470b-473b-a21a-ab3b527a138c tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:23 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-d561ba50-470b-473b-a21a-ab3b527a138c tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e3f2dda9bc49f48c66beb978dbdaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0091007734312b8d33caf294d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:56:23 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-d561ba50-470b-473b-a21a-ab3b527a138c tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2a860bd-802f-4760-b77b-92b7ac4ad09b" status: 200 len: 1551 microversion: 2.1 time: 0.230920 Apr 14 18:56:23 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 199/596] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:56:23 2023] GET /compute/v2.1/servers/a2a860bd-802f-4760-b77b-92b7ac4ad09b => generated 1551 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:56:24 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-c63e1583-3cda-48af-9067-c5cdd749183f req-2d613a56-0f3e-4205-b735-08cbb569f4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa09363f-435d-4fa8-9f11-db0c3f4e08be", "name": "network-vif-plugged", "status": "completed", "tag": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:56:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-c63e1583-3cda-48af-9067-c5cdd749183f req-2d613a56-0f3e-4205-b735-08cbb569f4b3 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-c63e1583-3cda-48af-9067-c5cdd749183f req-2d613a56-0f3e-4205-b735-08cbb569f4b3 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-c63e1583-3cda-48af-9067-c5cdd749183f req-2d613a56-0f3e-4205-b735-08cbb569f4b3 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:24 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-c63e1583-3cda-48af-9067-c5cdd749183f req-2d613a56-0f3e-4205-b735-08cbb569f4b3 service nova] Creating event network-vif-plugged:2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance aa09363f-435d-4fa8-9f11-db0c3f4e08be on user Apr 14 18:56:24 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-c63e1583-3cda-48af-9067-c5cdd749183f req-2d613a56-0f3e-4205-b735-08cbb569f4b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029646 Apr 14 18:56:24 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 202/597] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:56:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:56:26 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-903990961"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:56:26 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:56:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:26 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6e79e2cb-54c5-487e-b852-49303ee3e3cc/action" status: 202 len: 52 microversion: 2.87 time: 0.787107 Apr 14 18:56:26 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 197/598] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 18:56:26 2023] POST /compute/v2.1/servers/6e79e2cb-54c5-487e-b852-49303ee3e3cc/action => generated 52 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 14 18:56:31 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-d26392a3-8136-417f-8eae-eb0d7386b687 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:56:31 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-d26392a3-8136-417f-8eae-eb0d7386b687 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:56:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d26392a3-8136-417f-8eae-eb0d7386b687 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d26392a3-8136-417f-8eae-eb0d7386b687 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d26392a3-8136-417f-8eae-eb0d7386b687 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d26392a3-8136-417f-8eae-eb0d7386b687 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d26392a3-8136-417f-8eae-eb0d7386b687 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d26392a3-8136-417f-8eae-eb0d7386b687 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:31 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-d26392a3-8136-417f-8eae-eb0d7386b687 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] HTTP exception thrown: Instance 61944d61-738b-42a7-a95d-8caa6fa29a38 could not be found. Apr 14 18:56:31 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-d26392a3-8136-417f-8eae-eb0d7386b687 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Request method failure captured: Apr 14 18:56:31 user devstack@n-api.service[61675]: request: GET /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38 HTTP/1.1 Apr 14 18:56:31 user devstack@n-api.service[61675]: Accept: application/json Apr 14 18:56:31 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 18:56:31 user devstack@n-api.service[61675]: Connection: close Apr 14 18:56:31 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 18:56:31 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 18:56:31 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 18:56:31 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 18:56:31 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 18:56:31 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOZ9mXKmSeVaIS46ajndcD0QEVOAAeNy4LVRU6htix22YmE3w_WsO57Wi55e6NRGyVz084DhOrXI8Tp0cfqtkOuptABoiofobC3zYryQ5y6CuXjmj_BNK8q3Ywj-icF3eYh62IR4e0eJMk7NufTqqWbSFQxNccWUoyS1F1P0cbefqlTY Apr 14 18:56:31 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 18:56:31 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 18:56:31 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 18:56:31 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 18:56:31 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 18:56:31 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 18:56:31 user devstack@n-api.service[61675]: X-Project-Id: e34cdebcd7154988a957deae140e8eab Apr 14 18:56:31 user devstack@n-api.service[61675]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 18:56:31 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 18:56:31 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 18:56:31 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:56:31 user devstack@n-api.service[61675]: X-Tenant: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 18:56:31 user devstack@n-api.service[61675]: X-Tenant-Id: e34cdebcd7154988a957deae140e8eab Apr 14 18:56:31 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 18:56:31 user devstack@n-api.service[61675]: X-User: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 18:56:31 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 18:56:31 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 18:56:31 user devstack@n-api.service[61675]: X-User-Id: 8d53edaffb8f4038abd366d7942c6bc7 Apr 14 18:56:31 user devstack@n-api.service[61675]: X-User-Name: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 18:56:31 user devstack@n-api.service[61675]: method: > Apr 14 18:56:31 user devstack@n-api.service[61675]: exception: Instance 61944d61-738b-42a7-a95d-8caa6fa29a38 could not be found. Apr 14 18:56:31 user devstack@n-api.service[61675]: action_args: {'id': '61944d61-738b-42a7-a95d-8caa6fa29a38'} Apr 14 18:56:31 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61944d61-738b-42a7-a95d-8caa6fa29a38 could not be found. Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61944d61-738b-42a7-a95d-8caa6fa29a38 could not be found. Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61944d61-738b-42a7-a95d-8caa6fa29a38 could not be found. Apr 14 18:56:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:56:31 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-d26392a3-8136-417f-8eae-eb0d7386b687 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Returning 404 to user: Instance 61944d61-738b-42a7-a95d-8caa6fa29a38 could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:56:31 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-d26392a3-8136-417f-8eae-eb0d7386b687 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38" status: 404 len: 111 microversion: 2.1 time: 0.147822 Apr 14 18:56:31 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 200/599] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:56:31 2023] GET /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:56:31 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-6f3c0e85-2820-42f2-af39-917bd445484b tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '.version_select at 0x7fdae0f3e200>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:56:31 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-6f3c0e85-2820-42f2-af39-917bd445484b tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1273846851" status: 202 len: 0 microversion: 2.1 time: 0.022586 Apr 14 18:56:31 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 203/600] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 18:56:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1273846851 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:56:32 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-ab354427-e8e2-4946-819a-e2f1aaf52efb tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Action: 'create', calling method: .version_select at 0x7fdae0f67520>, body: {"keypair": {"name": "tempest-keypair-1888884509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2Y+X0ylyQAREcSqEFGU5KeK2JvYOxhUWKfD/HUL9LFnlnUPybIFrwN2cT6ZXOqujmMgrSHLf91Rlk8UY3HFa6RIp06SQEfEAyGI2m5HAFjxpzFiEFu0hqSEeY/EcUNmw=="}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:56:32 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-ab354427-e8e2-4946-819a-e2f1aaf52efb tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Getting quotas for project e34cdebcd7154988a957deae140e8eab. Resources: {'key_pairs'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:56:32 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-ab354427-e8e2-4946-819a-e2f1aaf52efb tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Getting quotas for user 8d53edaffb8f4038abd366d7942c6bc7 and project e34cdebcd7154988a957deae140e8eab. Resources: {'key_pairs'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:56:32 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-ab354427-e8e2-4946-819a-e2f1aaf52efb tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049926 Apr 14 18:56:32 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 198/601] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 18:56:32 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:56:32 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-c604e79e-3164-48b1-a1b4-620516deca13 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:56:32 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-c604e79e-3164-48b1-a1b4-620516deca13 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:56:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c604e79e-3164-48b1-a1b4-620516deca13 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c604e79e-3164-48b1-a1b4-620516deca13 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c604e79e-3164-48b1-a1b4-620516deca13 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c604e79e-3164-48b1-a1b4-620516deca13 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c604e79e-3164-48b1-a1b4-620516deca13 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c604e79e-3164-48b1-a1b4-620516deca13 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:32 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-c604e79e-3164-48b1-a1b4-620516deca13 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:56:32 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-c604e79e-3164-48b1-a1b4-620516deca13 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:56:32 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-c604e79e-3164-48b1-a1b4-620516deca13 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:56:32 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-c604e79e-3164-48b1-a1b4-620516deca13 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e79e2cb-54c5-487e-b852-49303ee3e3cc" status: 200 len: 1689 microversion: 2.87 time: 0.276429 Apr 14 18:56:32 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 201/602] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:56:32 2023] GET /compute/v2.1/servers/6e79e2cb-54c5-487e-b852-49303ee3e3cc => generated 1689 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:56:33 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2068101705", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ebff2aa0-97cc-48ab-8839-3dff795a5b06"}], "security_groups": [{"name": "tempest-securitygroup--575530685"}], "key_name": "tempest-keypair-1888884509", "user_data": "}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:56:33 user devstack@n-api.service[61674]: DEBUG nova.network.neutron [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] validate_networks() for [('ebff2aa0-97cc-48ab-8839-3dff795a5b06', None, None, None, None, None)] {{(pid=61674) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:56:33 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Flavor limits 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:56:33 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Image limits 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:56:33 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Flavor pref 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:56:33 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Image pref 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:56:33 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:56:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:34 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Getting quotas for project e34cdebcd7154988a957deae140e8eab. Resources: {'ram', 'instances', 'cores'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:56:34 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Getting quotas for user 8d53edaffb8f4038abd366d7942c6bc7 and project e34cdebcd7154988a957deae140e8eab. Resources: {'ram', 'instances', 'cores'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:56:34 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Going to run 1 instances... {{(pid=61674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:56:34 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:56:34 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.650929 Apr 14 18:56:34 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 204/603] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:56:33 2023] POST /compute/v2.1/servers => generated 399 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:56:34 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-05e2347e-3a35-4014-987c-c0a6475c946d tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:56:34 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-05e2347e-3a35-4014-987c-c0a6475c946d tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:56:34 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-05e2347e-3a35-4014-987c-c0a6475c946d tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d53edaffb8f4038abd366d7942c6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34cdebcd7154988a957deae140e8eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:56:34 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-05e2347e-3a35-4014-987c-c0a6475c946d tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d" status: 200 len: 1236 microversion: 2.1 time: 0.081260 Apr 14 18:56:34 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 199/604] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:56:34 2023] GET /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d => generated 1236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:56:37 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-ffac9d69-7008-49e8-bfe2-6b64b58f6573 req-3f9c458f-90fc-47ea-a10f-9643e60848b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68af5668-55ba-4150-be95-b6861afc820d", "tag": "bdc608b2-229e-4fc9-a251-dbb53cafa70a"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:56:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-ffac9d69-7008-49e8-bfe2-6b64b58f6573 req-3f9c458f-90fc-47ea-a10f-9643e60848b7 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-ffac9d69-7008-49e8-bfe2-6b64b58f6573 req-3f9c458f-90fc-47ea-a10f-9643e60848b7 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-ffac9d69-7008-49e8-bfe2-6b64b58f6573 req-3f9c458f-90fc-47ea-a10f-9643e60848b7 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:37 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-ffac9d69-7008-49e8-bfe2-6b64b58f6573 req-3f9c458f-90fc-47ea-a10f-9643e60848b7 service nova] Creating event network-changed:bdc608b2-229e-4fc9-a251-dbb53cafa70a for instance 68af5668-55ba-4150-be95-b6861afc820d on user Apr 14 18:56:37 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-ffac9d69-7008-49e8-bfe2-6b64b58f6573 req-3f9c458f-90fc-47ea-a10f-9643e60848b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100021 Apr 14 18:56:37 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 202/605] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:56:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:56:40 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-9a98f2e1-9c6c-412c-a3a7-61312885492c req-0758e6cc-341a-4307-82d6-21f39005849a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68af5668-55ba-4150-be95-b6861afc820d", "name": "network-vif-plugged", "status": "completed", "tag": "bdc608b2-229e-4fc9-a251-dbb53cafa70a"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:56:40 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:56:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-9a98f2e1-9c6c-412c-a3a7-61312885492c req-0758e6cc-341a-4307-82d6-21f39005849a service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-9a98f2e1-9c6c-412c-a3a7-61312885492c req-0758e6cc-341a-4307-82d6-21f39005849a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-9a98f2e1-9c6c-412c-a3a7-61312885492c req-0758e6cc-341a-4307-82d6-21f39005849a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:40 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=23 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:56:40 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-9a98f2e1-9c6c-412c-a3a7-61312885492c req-0758e6cc-341a-4307-82d6-21f39005849a service nova] Creating event network-vif-plugged:bdc608b2-229e-4fc9-a251-dbb53cafa70a for instance 68af5668-55ba-4150-be95-b6861afc820d on user Apr 14 18:56:40 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-9a98f2e1-9c6c-412c-a3a7-61312885492c req-0758e6cc-341a-4307-82d6-21f39005849a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040867 Apr 14 18:56:40 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 205/606] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:56:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:56:41 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-d4c6e370-1590-407e-92cf-ff35aedf05ce tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:56:41 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-d4c6e370-1590-407e-92cf-ff35aedf05ce tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:56:41 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:56:41 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:56:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d4c6e370-1590-407e-92cf-ff35aedf05ce tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d4c6e370-1590-407e-92cf-ff35aedf05ce tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d4c6e370-1590-407e-92cf-ff35aedf05ce tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d4c6e370-1590-407e-92cf-ff35aedf05ce tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d4c6e370-1590-407e-92cf-ff35aedf05ce tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d4c6e370-1590-407e-92cf-ff35aedf05ce tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:41 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-d4c6e370-1590-407e-92cf-ff35aedf05ce tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:56:41 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-d4c6e370-1590-407e-92cf-ff35aedf05ce tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc9e21d7-f70e-41ea-8ab1-9014f93ad508" status: 200 len: 1378 microversion: 2.1 time: 0.231018 Apr 14 18:56:41 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 200/607] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:56:41 2023] GET /compute/v2.1/servers/bc9e21d7-f70e-41ea-8ab1-9014f93ad508 => generated 1378 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:56:42 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-9f62e17f-07f6-4bd0-afca-164ba2121162 req-74540b90-68ea-46f1-9f4d-3894f9229b02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68af5668-55ba-4150-be95-b6861afc820d", "name": "network-vif-plugged", "status": "completed", "tag": "bdc608b2-229e-4fc9-a251-dbb53cafa70a"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:56:42 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:56:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-9f62e17f-07f6-4bd0-afca-164ba2121162 req-74540b90-68ea-46f1-9f4d-3894f9229b02 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-9f62e17f-07f6-4bd0-afca-164ba2121162 req-74540b90-68ea-46f1-9f4d-3894f9229b02 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-9f62e17f-07f6-4bd0-afca-164ba2121162 req-74540b90-68ea-46f1-9f4d-3894f9229b02 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:42 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=28 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:56:42 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-9f62e17f-07f6-4bd0-afca-164ba2121162 req-74540b90-68ea-46f1-9f4d-3894f9229b02 service nova] Creating event network-vif-plugged:bdc608b2-229e-4fc9-a251-dbb53cafa70a for instance 68af5668-55ba-4150-be95-b6861afc820d on user Apr 14 18:56:42 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-9f62e17f-07f6-4bd0-afca-164ba2121162 req-74540b90-68ea-46f1-9f4d-3894f9229b02 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041992 Apr 14 18:56:42 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 203/608] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:56:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:56:58 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:56:58 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=6 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:56:58 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-4cbb4352-6f03-4eca-ab1d-66100f45dc36 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:56:58 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-4cbb4352-6f03-4eca-ab1d-66100f45dc36 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:56:58 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4cbb4352-6f03-4eca-ab1d-66100f45dc36 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:58 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4cbb4352-6f03-4eca-ab1d-66100f45dc36 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:58 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4cbb4352-6f03-4eca-ab1d-66100f45dc36 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:58 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4cbb4352-6f03-4eca-ab1d-66100f45dc36 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:56:58 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4cbb4352-6f03-4eca-ab1d-66100f45dc36 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:56:58 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4cbb4352-6f03-4eca-ab1d-66100f45dc36 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:56:59 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-4cbb4352-6f03-4eca-ab1d-66100f45dc36 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:56:59 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-4cbb4352-6f03-4eca-ab1d-66100f45dc36 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 200 len: 1721 microversion: 2.1 time: 0.301507 Apr 14 18:56:59 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 206/609] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:56:58 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 1721 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:57:00 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-51545df0-c589-43b1-b89a-ace5b52f637f tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "382c87ed-2ef5-4d5f-a47c-1ad1d80b39ce"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:57:00 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-51545df0-c589-43b1-b89a-ace5b52f637f tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:57:00 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=6 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:57:00 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:57:00 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=6 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:57:00 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-51545df0-c589-43b1-b89a-ace5b52f637f tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:00 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-51545df0-c589-43b1-b89a-ace5b52f637f tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:00 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-51545df0-c589-43b1-b89a-ace5b52f637f tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:00 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-51545df0-c589-43b1-b89a-ace5b52f637f tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:00 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-51545df0-c589-43b1-b89a-ace5b52f637f tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:00 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-51545df0-c589-43b1-b89a-ace5b52f637f tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:00 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-51545df0-c589-43b1-b89a-ace5b52f637f tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 1d305ab4-1813-4728-a01c-287e521a05ec while it is in vm_state rescued Apr 14 18:57:00 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-51545df0-c589-43b1-b89a-ace5b52f637f tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Request method failure captured: Apr 14 18:57:00 user devstack@n-api.service[61673]: request: POST /compute/v2.1/servers/1d305ab4-1813-4728-a01c-287e521a05ec/os-volume_attachments HTTP/1.1 Apr 14 18:57:00 user devstack@n-api.service[61673]: Accept: application/json Apr 14 18:57:00 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 18:57:00 user devstack@n-api.service[61673]: Connection: close Apr 14 18:57:00 user devstack@n-api.service[61673]: Content-Length: 74 Apr 14 18:57:00 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 18:57:00 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 18:57:00 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 18:57:00 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 18:57:00 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOaBsVI_nvkyYSUnUpk_9LZivhBf1YZK5uRUFFR2iv7YLDTugI5hWoRijQ-9F1cI4hDuKdzxQWbf2lUpXfxiTO1q10jdi5iIMybz9kkHtzg_mWEjrwYVtbLI2p_4_sZODWdXkFWOQ0NLBMotwKrDrF_4nfgQcIHiwUOtMf5a-BxmB6jA Apr 14 18:57:00 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 18:57:00 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 18:57:00 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 18:57:00 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 18:57:00 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 18:57:00 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 18:57:00 user devstack@n-api.service[61673]: X-Project-Id: e60e8abd123e414f847c68ba72894689 Apr 14 18:57:00 user devstack@n-api.service[61673]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1174646715 Apr 14 18:57:00 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 18:57:00 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 18:57:00 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e60e8abd123e414f847c68ba72894689"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e60e8abd123e414f847c68ba72894689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e60e8abd123e414f847c68ba72894689"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:57:00 user devstack@n-api.service[61673]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1174646715 Apr 14 18:57:00 user devstack@n-api.service[61673]: X-Tenant-Id: e60e8abd123e414f847c68ba72894689 Apr 14 18:57:00 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1174646715 Apr 14 18:57:00 user devstack@n-api.service[61673]: X-User: tempest-ServerRescueNegativeTestJSON-1174646715-project-member Apr 14 18:57:00 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 18:57:00 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 18:57:00 user devstack@n-api.service[61673]: X-User-Id: c8713ed85ffb4446847f5ded4bc2e399 Apr 14 18:57:00 user devstack@n-api.service[61673]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1174646715-project-member Apr 14 18:57:00 user devstack@n-api.service[61673]: Apr 14 18:57:00 user devstack@n-api.service[61673]: {"volumeAttachment": {"volumeId": "382c87ed-2ef5-4d5f-a47c-1ad1d80b39ce"}} Apr 14 18:57:00 user devstack@n-api.service[61673]: method: > Apr 14 18:57:00 user devstack@n-api.service[61673]: exception: Cannot 'attach_volume' instance 1d305ab4-1813-4728-a01c-287e521a05ec while it is in vm_state rescued Apr 14 18:57:00 user devstack@n-api.service[61673]: action_args: {'server_id': '1d305ab4-1813-4728-a01c-287e521a05ec', 'body': {'volumeAttachment': {'volumeId': '382c87ed-2ef5-4d5f-a47c-1ad1d80b39ce'}}} Apr 14 18:57:00 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1d305ab4-1813-4728-a01c-287e521a05ec in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1d305ab4-1813-4728-a01c-287e521a05ec while it is in vm_state rescued Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1d305ab4-1813-4728-a01c-287e521a05ec while it is in vm_state rescued Apr 14 18:57:00 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:57:00 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-51545df0-c589-43b1-b89a-ace5b52f637f tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Returning 409 to user: Cannot 'attach_volume' instance 1d305ab4-1813-4728-a01c-287e521a05ec while it is in vm_state rescued {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:57:00 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-51545df0-c589-43b1-b89a-ace5b52f637f tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1d305ab4-1813-4728-a01c-287e521a05ec/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.054084 Apr 14 18:57:00 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 201/610] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 18:57:00 2023] POST /compute/v2.1/servers/1d305ab4-1813-4728-a01c-287e521a05ec/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 14 18:57:00 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:57:00 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:57:00 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-8faea003-5d3a-4990-b102-54c285f24e97 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:57:00 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-8faea003-5d3a-4990-b102-54c285f24e97 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:57:00 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8faea003-5d3a-4990-b102-54c285f24e97 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:00 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8faea003-5d3a-4990-b102-54c285f24e97 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:00 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8faea003-5d3a-4990-b102-54c285f24e97 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:00 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8faea003-5d3a-4990-b102-54c285f24e97 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:00 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8faea003-5d3a-4990-b102-54c285f24e97 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:00 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8faea003-5d3a-4990-b102-54c285f24e97 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:00 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-8faea003-5d3a-4990-b102-54c285f24e97 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1d305ab4-1813-4728-a01c-287e521a05ec/action" status: 202 len: 0 microversion: 2.1 time: 0.085826 Apr 14 18:57:00 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 204/611] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 18:57:00 2023] POST /compute/v2.1/servers/1d305ab4-1813-4728-a01c-287e521a05ec/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:57:00 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-ce6f9c14-3085-435e-a936-481acfc8f230 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:57:00 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-ce6f9c14-3085-435e-a936-481acfc8f230 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:57:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ce6f9c14-3085-435e-a936-481acfc8f230 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ce6f9c14-3085-435e-a936-481acfc8f230 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ce6f9c14-3085-435e-a936-481acfc8f230 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ce6f9c14-3085-435e-a936-481acfc8f230 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ce6f9c14-3085-435e-a936-481acfc8f230 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ce6f9c14-3085-435e-a936-481acfc8f230 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:00 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-ce6f9c14-3085-435e-a936-481acfc8f230 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8713ed85ffb4446847f5ded4bc2e399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60e8abd123e414f847c68ba72894689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:57:00 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-ce6f9c14-3085-435e-a936-481acfc8f230 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d305ab4-1813-4728-a01c-287e521a05ec" status: 200 len: 1498 microversion: 2.1 time: 0.223258 Apr 14 18:57:00 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 207/612] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:57:00 2023] GET /compute/v2.1/servers/1d305ab4-1813-4728-a01c-287e521a05ec => generated 1498 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:57:01 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-ee4c712f-be32-46bd-93cd-1ee5ce7defaa req-65f26bfd-9d34-45ae-bdd6-76b182ca7f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d305ab4-1813-4728-a01c-287e521a05ec", "name": "network-vif-unplugged", "status": "completed", "tag": "d07ff847-3983-4b35-af36-fbd845ede770"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:57:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-ee4c712f-be32-46bd-93cd-1ee5ce7defaa req-65f26bfd-9d34-45ae-bdd6-76b182ca7f24 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-ee4c712f-be32-46bd-93cd-1ee5ce7defaa req-65f26bfd-9d34-45ae-bdd6-76b182ca7f24 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-ee4c712f-be32-46bd-93cd-1ee5ce7defaa req-65f26bfd-9d34-45ae-bdd6-76b182ca7f24 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:01 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-ee4c712f-be32-46bd-93cd-1ee5ce7defaa req-65f26bfd-9d34-45ae-bdd6-76b182ca7f24 service nova] Creating event network-vif-unplugged:d07ff847-3983-4b35-af36-fbd845ede770 for instance 1d305ab4-1813-4728-a01c-287e521a05ec on user Apr 14 18:57:01 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-ee4c712f-be32-46bd-93cd-1ee5ce7defaa req-65f26bfd-9d34-45ae-bdd6-76b182ca7f24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032616 Apr 14 18:57:01 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 202/613] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:57:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:57:03 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-a5ef94d9-791c-4f6c-8cb5-25c8130794cf req-06e13bd9-cead-46f2-b7ba-f1f498d73e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d305ab4-1813-4728-a01c-287e521a05ec", "name": "network-vif-plugged", "status": "completed", "tag": "d07ff847-3983-4b35-af36-fbd845ede770"}, {"server_uuid": "1d305ab4-1813-4728-a01c-287e521a05ec", "name": "network-vif-plugged", "status": "completed", "tag": "d07ff847-3983-4b35-af36-fbd845ede770"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:57:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-a5ef94d9-791c-4f6c-8cb5-25c8130794cf req-06e13bd9-cead-46f2-b7ba-f1f498d73e87 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-a5ef94d9-791c-4f6c-8cb5-25c8130794cf req-06e13bd9-cead-46f2-b7ba-f1f498d73e87 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-a5ef94d9-791c-4f6c-8cb5-25c8130794cf req-06e13bd9-cead-46f2-b7ba-f1f498d73e87 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:03 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-a5ef94d9-791c-4f6c-8cb5-25c8130794cf req-06e13bd9-cead-46f2-b7ba-f1f498d73e87 service nova] Creating event network-vif-plugged:d07ff847-3983-4b35-af36-fbd845ede770 for instance 1d305ab4-1813-4728-a01c-287e521a05ec on user Apr 14 18:57:03 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-a5ef94d9-791c-4f6c-8cb5-25c8130794cf req-06e13bd9-cead-46f2-b7ba-f1f498d73e87 service nova] Creating event network-vif-plugged:d07ff847-3983-4b35-af36-fbd845ede770 for instance 1d305ab4-1813-4728-a01c-287e521a05ec on user Apr 14 18:57:03 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-a5ef94d9-791c-4f6c-8cb5-25c8130794cf req-06e13bd9-cead-46f2-b7ba-f1f498d73e87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035945 Apr 14 18:57:03 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 205/614] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:57:03 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:57:05 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-6960a3eb-17b8-454e-970c-e0f3b4ff5234 req-c03d8d98-b706-4334-8f1c-3984943e4a29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d305ab4-1813-4728-a01c-287e521a05ec", "name": "network-vif-plugged", "status": "completed", "tag": "d07ff847-3983-4b35-af36-fbd845ede770"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:57:05 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6960a3eb-17b8-454e-970c-e0f3b4ff5234 req-c03d8d98-b706-4334-8f1c-3984943e4a29 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:05 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6960a3eb-17b8-454e-970c-e0f3b4ff5234 req-c03d8d98-b706-4334-8f1c-3984943e4a29 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:05 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6960a3eb-17b8-454e-970c-e0f3b4ff5234 req-c03d8d98-b706-4334-8f1c-3984943e4a29 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:05 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-6960a3eb-17b8-454e-970c-e0f3b4ff5234 req-c03d8d98-b706-4334-8f1c-3984943e4a29 service nova] Creating event network-vif-plugged:d07ff847-3983-4b35-af36-fbd845ede770 for instance 1d305ab4-1813-4728-a01c-287e521a05ec on user Apr 14 18:57:05 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-6960a3eb-17b8-454e-970c-e0f3b4ff5234 req-c03d8d98-b706-4334-8f1c-3984943e4a29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029506 Apr 14 18:57:05 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 208/615] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:57:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:57:10 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-c11d2423-450d-4db4-939b-eb2776c2852f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-637075469"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:57:10 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-c11d2423-450d-4db4-939b-eb2776c2852f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:57:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c11d2423-450d-4db4-939b-eb2776c2852f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c11d2423-450d-4db4-939b-eb2776c2852f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c11d2423-450d-4db4-939b-eb2776c2852f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c11d2423-450d-4db4-939b-eb2776c2852f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c11d2423-450d-4db4-939b-eb2776c2852f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c11d2423-450d-4db4-939b-eb2776c2852f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:11 user devstack@n-api.service[61673]: INFO nova.network.security_group_api [None req-c11d2423-450d-4db4-939b-eb2776c2852f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Removing security group c18f669e-c0ac-4738-98c9-5e0bd068f15b from port 00582309-5b1a-4a4d-80b2-478c8f9ada29 Apr 14 18:57:11 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-c11d2423-450d-4db4-939b-eb2776c2852f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653/action" status: 202 len: 0 microversion: 2.1 time: 0.727504 Apr 14 18:57:11 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 203/616] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 18:57:10 2023] POST /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653/action => generated 0 bytes in 730 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:57:11 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-0c11c6bc-47ab-4cce-8352-a3e6b9f61a5e req-d73a47d9-514c-4d7d-9957-8819242f0ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cab14831-868c-40aa-b694-9e0185557653", "tag": "00582309-5b1a-4a4d-80b2-478c8f9ada29"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:57:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-0c11c6bc-47ab-4cce-8352-a3e6b9f61a5e req-d73a47d9-514c-4d7d-9957-8819242f0ac7 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-0c11c6bc-47ab-4cce-8352-a3e6b9f61a5e req-d73a47d9-514c-4d7d-9957-8819242f0ac7 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-0c11c6bc-47ab-4cce-8352-a3e6b9f61a5e req-d73a47d9-514c-4d7d-9957-8819242f0ac7 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:11 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-0c11c6bc-47ab-4cce-8352-a3e6b9f61a5e req-d73a47d9-514c-4d7d-9957-8819242f0ac7 service nova] Creating event network-changed:00582309-5b1a-4a4d-80b2-478c8f9ada29 for instance cab14831-868c-40aa-b694-9e0185557653 on user Apr 14 18:57:11 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-0c11c6bc-47ab-4cce-8352-a3e6b9f61a5e req-d73a47d9-514c-4d7d-9957-8819242f0ac7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131476 Apr 14 18:57:11 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 206/617] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:57:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:57:12 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-7a96fe3e-1325-4808-85e3-4b77ce919ed0 req-3cdad4e9-8e0b-4fba-82b8-780d3ecefa15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cab14831-868c-40aa-b694-9e0185557653", "tag": "00582309-5b1a-4a4d-80b2-478c8f9ada29"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:57:12 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-7a96fe3e-1325-4808-85e3-4b77ce919ed0 req-3cdad4e9-8e0b-4fba-82b8-780d3ecefa15 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:12 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-7a96fe3e-1325-4808-85e3-4b77ce919ed0 req-3cdad4e9-8e0b-4fba-82b8-780d3ecefa15 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:12 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-7a96fe3e-1325-4808-85e3-4b77ce919ed0 req-3cdad4e9-8e0b-4fba-82b8-780d3ecefa15 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:12 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-7a96fe3e-1325-4808-85e3-4b77ce919ed0 req-3cdad4e9-8e0b-4fba-82b8-780d3ecefa15 service nova] Creating event network-changed:00582309-5b1a-4a4d-80b2-478c8f9ada29 for instance cab14831-868c-40aa-b694-9e0185557653 on user Apr 14 18:57:12 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-7a96fe3e-1325-4808-85e3-4b77ce919ed0 req-3cdad4e9-8e0b-4fba-82b8-780d3ecefa15 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032814 Apr 14 18:57:12 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 204/618] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:57:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:57:12 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:57:12 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:57:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:12 user devstack@n-api.service[61674]: DEBUG nova.objects.instance [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lazy-loading 'services' on Instance uuid cab14831-868c-40aa-b694-9e0185557653 {{(pid=61674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 18:57:12 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653/os-volume_attachments/e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7" status: 202 len: 0 microversion: 2.1 time: 0.433746 Apr 14 18:57:12 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 209/619] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 18:57:12 2023] DELETE /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653/os-volume_attachments/e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:57:12 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-0910ba63-ef0b-4d11-a210-6be4549b6b64 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:57:12 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-0910ba63-ef0b-4d11-a210-6be4549b6b64 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:57:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0910ba63-ef0b-4d11-a210-6be4549b6b64 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0910ba63-ef0b-4d11-a210-6be4549b6b64 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0910ba63-ef0b-4d11-a210-6be4549b6b64 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0910ba63-ef0b-4d11-a210-6be4549b6b64 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0910ba63-ef0b-4d11-a210-6be4549b6b64 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0910ba63-ef0b-4d11-a210-6be4549b6b64 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:12 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-0910ba63-ef0b-4d11-a210-6be4549b6b64 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082591 Apr 14 18:57:12 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 207/620] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:57:12 2023] GET /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:57:13 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-132f9c40-bb26-488e-8890-e814ade14580 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:57:13 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-132f9c40-bb26-488e-8890-e814ade14580 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:57:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-132f9c40-bb26-488e-8890-e814ade14580 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-132f9c40-bb26-488e-8890-e814ade14580 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-132f9c40-bb26-488e-8890-e814ade14580 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-132f9c40-bb26-488e-8890-e814ade14580 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-132f9c40-bb26-488e-8890-e814ade14580 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-132f9c40-bb26-488e-8890-e814ade14580 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:14 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-132f9c40-bb26-488e-8890-e814ade14580 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a9414d0c24643fdb162aad828c736bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921435d84194431c886ec1ed1848d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:57:14 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-132f9c40-bb26-488e-8890-e814ade14580 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1feb4399-a5dc-43a7-ac78-4d22809e2737" status: 200 len: 1536 microversion: 2.1 time: 0.221212 Apr 14 18:57:14 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 205/621] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:57:13 2023] GET /compute/v2.1/servers/1feb4399-a5dc-43a7-ac78-4d22809e2737 => generated 1536 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:57:15 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-e7d02e2b-7fe2-4c28-b3b5-b4ae246e1914 req-0c0987e4-56ca-48b6-b402-e1439b022be9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1feb4399-a5dc-43a7-ac78-4d22809e2737", "tag": "99fafc78-521b-4f9c-81fe-9571483238c1"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:57:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-e7d02e2b-7fe2-4c28-b3b5-b4ae246e1914 req-0c0987e4-56ca-48b6-b402-e1439b022be9 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-e7d02e2b-7fe2-4c28-b3b5-b4ae246e1914 req-0c0987e4-56ca-48b6-b402-e1439b022be9 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-e7d02e2b-7fe2-4c28-b3b5-b4ae246e1914 req-0c0987e4-56ca-48b6-b402-e1439b022be9 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:15 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-e7d02e2b-7fe2-4c28-b3b5-b4ae246e1914 req-0c0987e4-56ca-48b6-b402-e1439b022be9 service nova] Creating event network-changed:99fafc78-521b-4f9c-81fe-9571483238c1 for instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 on user Apr 14 18:57:15 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-e7d02e2b-7fe2-4c28-b3b5-b4ae246e1914 req-0c0987e4-56ca-48b6-b402-e1439b022be9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045851 Apr 14 18:57:15 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 210/622] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:57:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:57:15 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f70d8b48-53a5-4ce4-bc42-2e4bf34d3695"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:57:15 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:57:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:16 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1feb4399-a5dc-43a7-ac78-4d22809e2737/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283413 Apr 14 18:57:16 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 208/623] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 18:57:15 2023] POST /compute/v2.1/servers/1feb4399-a5dc-43a7-ac78-4d22809e2737/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:57:16 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:57:16 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:57:16 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:16 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:16 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:16 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:16 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:16 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:16 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Going to try to terminate instance {{(pid=61673) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 18:57:16 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8832a321-f1ac-411a-8fc9-1fc816bffec6" status: 204 len: 0 microversion: 2.1 time: 0.202966 Apr 14 18:57:16 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 206/624] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 18:57:16 2023] DELETE /compute/v2.1/servers/8832a321-f1ac-411a-8fc9-1fc816bffec6 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 18:57:16 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-18790a7f-6143-4c85-8579-572b2e5a96cd tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:57:16 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-18790a7f-6143-4c85-8579-572b2e5a96cd tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:57:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-18790a7f-6143-4c85-8579-572b2e5a96cd tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-18790a7f-6143-4c85-8579-572b2e5a96cd tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-18790a7f-6143-4c85-8579-572b2e5a96cd tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-18790a7f-6143-4c85-8579-572b2e5a96cd tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-18790a7f-6143-4c85-8579-572b2e5a96cd tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-18790a7f-6143-4c85-8579-572b2e5a96cd tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:16 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:57:16 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:57:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:16 user devstack@n-api.service[61675]: DEBUG nova.objects.instance [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'services' on Instance uuid 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=61675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 18:57:16 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-18790a7f-6143-4c85-8579-572b2e5a96cd tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008a24026e844252b0be1268461bc2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af68184e7654efea3187e05bb10e5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:57:16 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-18790a7f-6143-4c85-8579-572b2e5a96cd tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8832a321-f1ac-411a-8fc9-1fc816bffec6" status: 200 len: 1498 microversion: 2.1 time: 0.298657 Apr 14 18:57:16 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 211/625] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:57:16 2023] GET /compute/v2.1/servers/8832a321-f1ac-411a-8fc9-1fc816bffec6 => generated 1498 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:57:16 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/os-volume_attachments/8870d3d7-990b-4d4c-8d7a-4591106f1a3a" status: 202 len: 0 microversion: 2.1 time: 0.302984 Apr 14 18:57:16 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 209/626] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 18:57:16 2023] DELETE /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/os-volume_attachments/8870d3d7-990b-4d4c-8d7a-4591106f1a3a => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:57:17 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-2f4b9c65-487c-4e4f-b924-67e0be47fe7b req-9936aac6-1384-4b53-9649-f96ac1c16e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8832a321-f1ac-411a-8fc9-1fc816bffec6", "name": "network-vif-unplugged", "status": "completed", "tag": "e4886e4d-4e50-4de8-93e6-61be10466add"}, {"server_uuid": "8832a321-f1ac-411a-8fc9-1fc816bffec6", "name": "network-vif-plugged", "status": "completed", "tag": "e4886e4d-4e50-4de8-93e6-61be10466add"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:57:17 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-2f4b9c65-487c-4e4f-b924-67e0be47fe7b req-9936aac6-1384-4b53-9649-f96ac1c16e44 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:17 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-2f4b9c65-487c-4e4f-b924-67e0be47fe7b req-9936aac6-1384-4b53-9649-f96ac1c16e44 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:17 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-2f4b9c65-487c-4e4f-b924-67e0be47fe7b req-9936aac6-1384-4b53-9649-f96ac1c16e44 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:17 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-2f4b9c65-487c-4e4f-b924-67e0be47fe7b req-9936aac6-1384-4b53-9649-f96ac1c16e44 service nova] Creating event network-vif-unplugged:e4886e4d-4e50-4de8-93e6-61be10466add for instance 8832a321-f1ac-411a-8fc9-1fc816bffec6 on user Apr 14 18:57:17 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-2f4b9c65-487c-4e4f-b924-67e0be47fe7b req-9936aac6-1384-4b53-9649-f96ac1c16e44 service nova] Creating event network-vif-plugged:e4886e4d-4e50-4de8-93e6-61be10466add for instance 8832a321-f1ac-411a-8fc9-1fc816bffec6 on user Apr 14 18:57:17 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-2f4b9c65-487c-4e4f-b924-67e0be47fe7b req-9936aac6-1384-4b53-9649-f96ac1c16e44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.050300 Apr 14 18:57:17 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 207/627] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:57:17 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:57:18 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-a2f72573-ba71-452d-a1b2-5d4b95b254c2 req-622256eb-ee0a-4b6f-8fb7-2b2a8741708d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8832a321-f1ac-411a-8fc9-1fc816bffec6", "name": "network-vif-deleted", "tag": "e4886e4d-4e50-4de8-93e6-61be10466add"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:57:18 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-a2f72573-ba71-452d-a1b2-5d4b95b254c2 req-622256eb-ee0a-4b6f-8fb7-2b2a8741708d service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:18 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-a2f72573-ba71-452d-a1b2-5d4b95b254c2 req-622256eb-ee0a-4b6f-8fb7-2b2a8741708d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:18 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-a2f72573-ba71-452d-a1b2-5d4b95b254c2 req-622256eb-ee0a-4b6f-8fb7-2b2a8741708d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:18 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-a2f72573-ba71-452d-a1b2-5d4b95b254c2 req-622256eb-ee0a-4b6f-8fb7-2b2a8741708d service nova] Creating event network-vif-deleted:e4886e4d-4e50-4de8-93e6-61be10466add for instance 8832a321-f1ac-411a-8fc9-1fc816bffec6 on user Apr 14 18:57:18 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-a2f72573-ba71-452d-a1b2-5d4b95b254c2 req-622256eb-ee0a-4b6f-8fb7-2b2a8741708d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038913 Apr 14 18:57:18 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 212/628] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:57:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:57:19 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-71c13240-73ab-4b25-a051-5e318d8fe7fa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:57:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-71c13240-73ab-4b25-a051-5e318d8fe7fa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-71c13240-73ab-4b25-a051-5e318d8fe7fa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-71c13240-73ab-4b25-a051-5e318d8fe7fa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:19 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-71c13240-73ab-4b25-a051-5e318d8fe7fa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Going to try to stop instance {{(pid=61675) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 14 18:57:19 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-71c13240-73ab-4b25-a051-5e318d8fe7fa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/action" status: 202 len: 0 microversion: 2.1 time: 0.079117 Apr 14 18:57:19 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 210/629] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 18:57:19 2023] POST /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:57:19 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-6f03763c-3a0c-47e9-b443-c00f58bdcd30 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:57:19 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-6f03763c-3a0c-47e9-b443-c00f58bdcd30 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:57:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6f03763c-3a0c-47e9-b443-c00f58bdcd30 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6f03763c-3a0c-47e9-b443-c00f58bdcd30 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6f03763c-3a0c-47e9-b443-c00f58bdcd30 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6f03763c-3a0c-47e9-b443-c00f58bdcd30 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6f03763c-3a0c-47e9-b443-c00f58bdcd30 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6f03763c-3a0c-47e9-b443-c00f58bdcd30 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:19 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-6f03763c-3a0c-47e9-b443-c00f58bdcd30 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f90c8f23e3b42a98fdb9261db65f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf25bcc0dea4d3eb1284e8995eb3466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:57:19 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-6f03763c-3a0c-47e9-b443-c00f58bdcd30 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4" status: 200 len: 1666 microversion: 2.1 time: 0.282685 Apr 14 18:57:19 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 208/630] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:57:19 2023] GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4 => generated 1666 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:57:19 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-0f1e8745-112c-4a48-b355-ed3046cb9a51 req-b94448b0-9404-4102-9a15-1569005701fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0050e6bb-0b53-4fdc-8437-16b94ee79fa4", "name": "network-vif-unplugged", "status": "completed", "tag": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21"}, {"server_uuid": "0050e6bb-0b53-4fdc-8437-16b94ee79fa4", "name": "network-vif-plugged", "status": "completed", "tag": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:57:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-0f1e8745-112c-4a48-b355-ed3046cb9a51 req-b94448b0-9404-4102-9a15-1569005701fe service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-0f1e8745-112c-4a48-b355-ed3046cb9a51 req-b94448b0-9404-4102-9a15-1569005701fe service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-0f1e8745-112c-4a48-b355-ed3046cb9a51 req-b94448b0-9404-4102-9a15-1569005701fe service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:19 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-0f1e8745-112c-4a48-b355-ed3046cb9a51 req-b94448b0-9404-4102-9a15-1569005701fe service nova] Creating event network-vif-unplugged:2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 on user Apr 14 18:57:19 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-0f1e8745-112c-4a48-b355-ed3046cb9a51 req-b94448b0-9404-4102-9a15-1569005701fe service nova] Creating event network-vif-plugged:2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 on user Apr 14 18:57:19 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-0f1e8745-112c-4a48-b355-ed3046cb9a51 req-b94448b0-9404-4102-9a15-1569005701fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.038043 Apr 14 18:57:19 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 213/631] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:57:19 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:57:24 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-cc68a216-35de-4161-b6c7-98125e4e0273 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:57:24 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-cc68a216-35de-4161-b6c7-98125e4e0273 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:57:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-cc68a216-35de-4161-b6c7-98125e4e0273 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-cc68a216-35de-4161-b6c7-98125e4e0273 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-cc68a216-35de-4161-b6c7-98125e4e0273 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-cc68a216-35de-4161-b6c7-98125e4e0273 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-cc68a216-35de-4161-b6c7-98125e4e0273 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-cc68a216-35de-4161-b6c7-98125e4e0273 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:24 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-cc68a216-35de-4161-b6c7-98125e4e0273 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d53edaffb8f4038abd366d7942c6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34cdebcd7154988a957deae140e8eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:57:24 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-cc68a216-35de-4161-b6c7-98125e4e0273 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d" status: 200 len: 1544 microversion: 2.1 time: 0.269500 Apr 14 18:57:24 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 211/632] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:57:24 2023] GET /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d => generated 1544 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:57:24 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:57:24 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:57:24 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-495a9f4b-ac5e-42ad-99c4-6b8c488131b7 req-53aba6ba-6177-479f-aac5-541d7b8e08e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a860bd-802f-4760-b77b-92b7ac4ad09b", "tag": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:57:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:24 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-495a9f4b-ac5e-42ad-99c4-6b8c488131b7 req-53aba6ba-6177-479f-aac5-541d7b8e08e0 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-495a9f4b-ac5e-42ad-99c4-6b8c488131b7 req-53aba6ba-6177-479f-aac5-541d7b8e08e0 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-495a9f4b-ac5e-42ad-99c4-6b8c488131b7 req-53aba6ba-6177-479f-aac5-541d7b8e08e0 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:24 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-495a9f4b-ac5e-42ad-99c4-6b8c488131b7 req-53aba6ba-6177-479f-aac5-541d7b8e08e0 service nova] Creating event network-changed:ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 for instance a2a860bd-802f-4760-b77b-92b7ac4ad09b on user Apr 14 18:57:24 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-495a9f4b-ac5e-42ad-99c4-6b8c488131b7 req-53aba6ba-6177-479f-aac5-541d7b8e08e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045152 Apr 14 18:57:24 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 214/633] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:57:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 18:57:24 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Going to try to terminate instance {{(pid=61673) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 18:57:24 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a2a860bd-802f-4760-b77b-92b7ac4ad09b" status: 204 len: 0 microversion: 2.1 time: 0.180599 Apr 14 18:57:24 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 209/634] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 18:57:24 2023] DELETE /compute/v2.1/servers/a2a860bd-802f-4760-b77b-92b7ac4ad09b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 18:57:24 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-05d5113d-7eda-4737-be24-30a0040adf80 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:57:24 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-05d5113d-7eda-4737-be24-30a0040adf80 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:57:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-05d5113d-7eda-4737-be24-30a0040adf80 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-05d5113d-7eda-4737-be24-30a0040adf80 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-05d5113d-7eda-4737-be24-30a0040adf80 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-05d5113d-7eda-4737-be24-30a0040adf80 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-05d5113d-7eda-4737-be24-30a0040adf80 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-05d5113d-7eda-4737-be24-30a0040adf80 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:24 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:57:24 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:57:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:25 user devstack@n-api.service[61674]: DEBUG nova.objects.instance [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lazy-loading 'services' on Instance uuid 1feb4399-a5dc-43a7-ac78-4d22809e2737 {{(pid=61674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 18:57:25 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1feb4399-a5dc-43a7-ac78-4d22809e2737/os-volume_attachments/f70d8b48-53a5-4ce4-bc42-2e4bf34d3695" status: 202 len: 0 microversion: 2.1 time: 0.185166 Apr 14 18:57:25 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 215/635] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 18:57:24 2023] DELETE /compute/v2.1/servers/1feb4399-a5dc-43a7-ac78-4d22809e2737/os-volume_attachments/f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:57:25 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-45ec4087-e8b3-405c-99f7-df83ea7705e4 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:57:25 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-45ec4087-e8b3-405c-99f7-df83ea7705e4 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:57:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-45ec4087-e8b3-405c-99f7-df83ea7705e4 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-45ec4087-e8b3-405c-99f7-df83ea7705e4 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-45ec4087-e8b3-405c-99f7-df83ea7705e4 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:25 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-10970784-f2d4-442d-a5e3-5b3bd8ea457c req-8565f5a4-202b-4bba-b5b2-caf365697d90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a860bd-802f-4760-b77b-92b7ac4ad09b", "name": "network-vif-unplugged", "status": "completed", "tag": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:57:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-45ec4087-e8b3-405c-99f7-df83ea7705e4 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-45ec4087-e8b3-405c-99f7-df83ea7705e4 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-45ec4087-e8b3-405c-99f7-df83ea7705e4 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-10970784-f2d4-442d-a5e3-5b3bd8ea457c req-8565f5a4-202b-4bba-b5b2-caf365697d90 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-10970784-f2d4-442d-a5e3-5b3bd8ea457c req-8565f5a4-202b-4bba-b5b2-caf365697d90 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-10970784-f2d4-442d-a5e3-5b3bd8ea457c req-8565f5a4-202b-4bba-b5b2-caf365697d90 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:25 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-10970784-f2d4-442d-a5e3-5b3bd8ea457c req-8565f5a4-202b-4bba-b5b2-caf365697d90 service nova] Creating event network-vif-unplugged:ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 for instance a2a860bd-802f-4760-b77b-92b7ac4ad09b on user Apr 14 18:57:25 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-10970784-f2d4-442d-a5e3-5b3bd8ea457c req-8565f5a4-202b-4bba-b5b2-caf365697d90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040452 Apr 14 18:57:25 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 216/636] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:57:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:57:25 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-45ec4087-e8b3-405c-99f7-df83ea7705e4 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1feb4399-a5dc-43a7-ac78-4d22809e2737/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070045 Apr 14 18:57:25 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 210/637] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:57:25 2023] GET /compute/v2.1/servers/1feb4399-a5dc-43a7-ac78-4d22809e2737/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:57:25 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-05d5113d-7eda-4737-be24-30a0040adf80 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e3f2dda9bc49f48c66beb978dbdaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0091007734312b8d33caf294d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:57:25 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-05d5113d-7eda-4737-be24-30a0040adf80 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2a860bd-802f-4760-b77b-92b7ac4ad09b" status: 200 len: 1557 microversion: 2.1 time: 0.493155 Apr 14 18:57:25 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 212/638] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:57:24 2023] GET /compute/v2.1/servers/a2a860bd-802f-4760-b77b-92b7ac4ad09b => generated 1557 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 18:57:27 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-ca67474d-48e2-4234-b48d-fa8e44d686de req-2dd1104e-7642-4295-a818-97c211bcf533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a860bd-802f-4760-b77b-92b7ac4ad09b", "name": "network-vif-deleted", "tag": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:57:27 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-ca67474d-48e2-4234-b48d-fa8e44d686de req-2dd1104e-7642-4295-a818-97c211bcf533 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:27 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-ca67474d-48e2-4234-b48d-fa8e44d686de req-2dd1104e-7642-4295-a818-97c211bcf533 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:27 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-ca67474d-48e2-4234-b48d-fa8e44d686de req-2dd1104e-7642-4295-a818-97c211bcf533 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:27 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-ca67474d-48e2-4234-b48d-fa8e44d686de req-2dd1104e-7642-4295-a818-97c211bcf533 service nova] Creating event network-vif-deleted:ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 for instance a2a860bd-802f-4760-b77b-92b7ac4ad09b on user Apr 14 18:57:27 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-ca67474d-48e2-4234-b48d-fa8e44d686de req-2dd1104e-7642-4295-a818-97c211bcf533 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032198 Apr 14 18:57:27 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 217/639] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:57:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:57:27 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-f25ea7e7-5c43-4a94-9722-0e3eb084c598 req-2d147072-d3b6-4cec-bb6f-8670bba60e3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a860bd-802f-4760-b77b-92b7ac4ad09b", "name": "network-vif-plugged", "status": "completed", "tag": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:57:27 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-f25ea7e7-5c43-4a94-9722-0e3eb084c598 req-2d147072-d3b6-4cec-bb6f-8670bba60e3c service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:27 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-f25ea7e7-5c43-4a94-9722-0e3eb084c598 req-2d147072-d3b6-4cec-bb6f-8670bba60e3c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:27 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-f25ea7e7-5c43-4a94-9722-0e3eb084c598 req-2d147072-d3b6-4cec-bb6f-8670bba60e3c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:27 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-f25ea7e7-5c43-4a94-9722-0e3eb084c598 req-2d147072-d3b6-4cec-bb6f-8670bba60e3c service nova] Creating event network-vif-plugged:ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 for instance a2a860bd-802f-4760-b77b-92b7ac4ad09b on user Apr 14 18:57:27 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-f25ea7e7-5c43-4a94-9722-0e3eb084c598 req-2d147072-d3b6-4cec-bb6f-8670bba60e3c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029855 Apr 14 18:57:27 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 211/640] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:57:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:57:32 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1753583208", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "destination_type": "volume"}], "networks": [{"uuid": "a4933fe8-a8cc-498f-925f-185cdae2f1f7"}]}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:57:32 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=19 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:57:32 user devstack@n-api.service[61675]: DEBUG nova.network.neutron [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] validate_networks() for [('a4933fe8-a8cc-498f-925f-185cdae2f1f7', None, None, None, None, None)] {{(pid=61675) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:57:34 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Flavor limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:57:34 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Image limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:57:34 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Flavor pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:57:34 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Image pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:57:34 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:57:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:34 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:57:34 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Getting quotas for project 424e732759884efa8fd126cd9a082c8a. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:57:34 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Getting quotas for user a644b8bb9b90494ba670da8315bfe005 and project 424e732759884efa8fd126cd9a082c8a. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:57:34 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Going to run 1 instances... {{(pid=61675) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:57:34 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:57:34 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.451978 Apr 14 18:57:34 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 213/641] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 18:57:32 2023] POST /compute/v2.1/servers => generated 378 bytes in 1453 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 18:57:34 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-7fb31c24-4774-4aac-974f-a7cd45d8ca04 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:57:34 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-7fb31c24-4774-4aac-974f-a7cd45d8ca04 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:57:34 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=26 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:57:34 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-7fb31c24-4774-4aac-974f-a7cd45d8ca04 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:57:34 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-7fb31c24-4774-4aac-974f-a7cd45d8ca04 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:57:34 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-7fb31c24-4774-4aac-974f-a7cd45d8ca04 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:57:34 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-7fb31c24-4774-4aac-974f-a7cd45d8ca04 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" status: 200 len: 1395 microversion: 2.87 time: 0.101929 Apr 14 18:57:34 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 218/642] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:57:34 2023] GET /compute/v2.1/servers/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 => generated 1395 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:57:37 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:57:37 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:57:37 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-765ac660-d2de-4723-87e6-c653bfb1eefd req-35447d44-1667-41fd-b230-a3d52301227e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1", "tag": "3a14f42c-2105-477c-8012-069d489f2d91"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:57:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-765ac660-d2de-4723-87e6-c653bfb1eefd req-35447d44-1667-41fd-b230-a3d52301227e service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-765ac660-d2de-4723-87e6-c653bfb1eefd req-35447d44-1667-41fd-b230-a3d52301227e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-765ac660-d2de-4723-87e6-c653bfb1eefd req-35447d44-1667-41fd-b230-a3d52301227e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:37 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-765ac660-d2de-4723-87e6-c653bfb1eefd req-35447d44-1667-41fd-b230-a3d52301227e service nova] Creating event network-changed:3a14f42c-2105-477c-8012-069d489f2d91 for instance 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 on user Apr 14 18:57:37 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-765ac660-d2de-4723-87e6-c653bfb1eefd req-35447d44-1667-41fd-b230-a3d52301227e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057071 Apr 14 18:57:37 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 212/643] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:57:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:57:41 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-771c36d9-1613-48de-a00d-cb328af2187e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:57:41 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-771c36d9-1613-48de-a00d-cb328af2187e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:57:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-771c36d9-1613-48de-a00d-cb328af2187e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-771c36d9-1613-48de-a00d-cb328af2187e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-771c36d9-1613-48de-a00d-cb328af2187e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-771c36d9-1613-48de-a00d-cb328af2187e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-771c36d9-1613-48de-a00d-cb328af2187e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-771c36d9-1613-48de-a00d-cb328af2187e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:42 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-771c36d9-1613-48de-a00d-cb328af2187e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:57:42 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-771c36d9-1613-48de-a00d-cb328af2187e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc9e21d7-f70e-41ea-8ab1-9014f93ad508" status: 200 len: 1378 microversion: 2.1 time: 0.233611 Apr 14 18:57:42 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 214/644] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:57:41 2023] GET /compute/v2.1/servers/bc9e21d7-f70e-41ea-8ab1-9014f93ad508 => generated 1378 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:57:42 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-65ea7fae-62b5-4284-b070-3e3f41a67fdf tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:57:42 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-65ea7fae-62b5-4284-b070-3e3f41a67fdf tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:57:42 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:57:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-65ea7fae-62b5-4284-b070-3e3f41a67fdf tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-65ea7fae-62b5-4284-b070-3e3f41a67fdf tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-65ea7fae-62b5-4284-b070-3e3f41a67fdf tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-65ea7fae-62b5-4284-b070-3e3f41a67fdf tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-65ea7fae-62b5-4284-b070-3e3f41a67fdf tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-65ea7fae-62b5-4284-b070-3e3f41a67fdf tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:42 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-65ea7fae-62b5-4284-b070-3e3f41a67fdf tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:57:42 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-65ea7fae-62b5-4284-b070-3e3f41a67fdf tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc9e21d7-f70e-41ea-8ab1-9014f93ad508" status: 200 len: 1378 microversion: 2.1 time: 0.165977 Apr 14 18:57:42 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 219/645] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:57:42 2023] GET /compute/v2.1/servers/bc9e21d7-f70e-41ea-8ab1-9014f93ad508 => generated 1378 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:57:42 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:57:42 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:57:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:42 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Going to try to terminate instance {{(pid=61673) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 18:57:42 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bc9e21d7-f70e-41ea-8ab1-9014f93ad508" status: 204 len: 0 microversion: 2.1 time: 0.120015 Apr 14 18:57:42 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 213/646] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 18:57:42 2023] DELETE /compute/v2.1/servers/bc9e21d7-f70e-41ea-8ab1-9014f93ad508 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 18:57:42 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-9e2c8981-ce27-4ba3-85f9-c57f48bbd2fd tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:57:42 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-9e2c8981-ce27-4ba3-85f9-c57f48bbd2fd tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:57:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9e2c8981-ce27-4ba3-85f9-c57f48bbd2fd tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9e2c8981-ce27-4ba3-85f9-c57f48bbd2fd tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9e2c8981-ce27-4ba3-85f9-c57f48bbd2fd tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9e2c8981-ce27-4ba3-85f9-c57f48bbd2fd tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9e2c8981-ce27-4ba3-85f9-c57f48bbd2fd tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9e2c8981-ce27-4ba3-85f9-c57f48bbd2fd tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:42 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-9e2c8981-ce27-4ba3-85f9-c57f48bbd2fd tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:57:42 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-9e2c8981-ce27-4ba3-85f9-c57f48bbd2fd tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc9e21d7-f70e-41ea-8ab1-9014f93ad508" status: 200 len: 1384 microversion: 2.1 time: 0.190115 Apr 14 18:57:42 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 215/647] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:57:42 2023] GET /compute/v2.1/servers/bc9e21d7-f70e-41ea-8ab1-9014f93ad508 => generated 1384 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:57:42 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-817b0303-72bc-4f73-8c1a-3dbecea24a8b req-01d5c455-53cb-4534-9b31-d4e0e97a3188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc9e21d7-f70e-41ea-8ab1-9014f93ad508", "name": "network-vif-unplugged", "status": "completed", "tag": "62e9aa7c-0fd9-4498-9592-9bff455b6bbf"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:57:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-817b0303-72bc-4f73-8c1a-3dbecea24a8b req-01d5c455-53cb-4534-9b31-d4e0e97a3188 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-817b0303-72bc-4f73-8c1a-3dbecea24a8b req-01d5c455-53cb-4534-9b31-d4e0e97a3188 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-817b0303-72bc-4f73-8c1a-3dbecea24a8b req-01d5c455-53cb-4534-9b31-d4e0e97a3188 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:42 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-817b0303-72bc-4f73-8c1a-3dbecea24a8b req-01d5c455-53cb-4534-9b31-d4e0e97a3188 service nova] Creating event network-vif-unplugged:62e9aa7c-0fd9-4498-9592-9bff455b6bbf for instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508 on user Apr 14 18:57:42 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-817b0303-72bc-4f73-8c1a-3dbecea24a8b req-01d5c455-53cb-4534-9b31-d4e0e97a3188 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037453 Apr 14 18:57:42 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 220/648] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:57:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:57:44 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-5f1d4cf1-f7c3-4126-b3bd-174b3574e0d4 req-dc5d09cb-c439-45fb-b3dc-b6518d1f2103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc9e21d7-f70e-41ea-8ab1-9014f93ad508", "name": "network-vif-plugged", "status": "completed", "tag": "62e9aa7c-0fd9-4498-9592-9bff455b6bbf"}, {"server_uuid": "bc9e21d7-f70e-41ea-8ab1-9014f93ad508", "name": "network-vif-deleted", "tag": "62e9aa7c-0fd9-4498-9592-9bff455b6bbf"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:57:44 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-5f1d4cf1-f7c3-4126-b3bd-174b3574e0d4 req-dc5d09cb-c439-45fb-b3dc-b6518d1f2103 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:44 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-5f1d4cf1-f7c3-4126-b3bd-174b3574e0d4 req-dc5d09cb-c439-45fb-b3dc-b6518d1f2103 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:44 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-5f1d4cf1-f7c3-4126-b3bd-174b3574e0d4 req-dc5d09cb-c439-45fb-b3dc-b6518d1f2103 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:44 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-5f1d4cf1-f7c3-4126-b3bd-174b3574e0d4 req-dc5d09cb-c439-45fb-b3dc-b6518d1f2103 service nova] Creating event network-vif-plugged:62e9aa7c-0fd9-4498-9592-9bff455b6bbf for instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508 on user Apr 14 18:57:44 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-5f1d4cf1-f7c3-4126-b3bd-174b3574e0d4 req-dc5d09cb-c439-45fb-b3dc-b6518d1f2103 service nova] Creating event network-vif-deleted:62e9aa7c-0fd9-4498-9592-9bff455b6bbf for instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508 on user Apr 14 18:57:44 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-5f1d4cf1-f7c3-4126-b3bd-174b3574e0d4 req-dc5d09cb-c439-45fb-b3dc-b6518d1f2103 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029547 Apr 14 18:57:44 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 214/649] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:57:44 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:57:49 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-0d760d63-9331-4102-9a42-8e35336fc12d req-cb39e2b3-adf7-45c4-989e-7a6ee0623e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1", "name": "network-vif-plugged", "status": "completed", "tag": "3a14f42c-2105-477c-8012-069d489f2d91"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:57:49 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:57:49 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=6 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:57:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-0d760d63-9331-4102-9a42-8e35336fc12d req-cb39e2b3-adf7-45c4-989e-7a6ee0623e2d service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-0d760d63-9331-4102-9a42-8e35336fc12d req-cb39e2b3-adf7-45c4-989e-7a6ee0623e2d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-0d760d63-9331-4102-9a42-8e35336fc12d req-cb39e2b3-adf7-45c4-989e-7a6ee0623e2d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:49 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-0d760d63-9331-4102-9a42-8e35336fc12d req-cb39e2b3-adf7-45c4-989e-7a6ee0623e2d service nova] Creating event network-vif-plugged:3a14f42c-2105-477c-8012-069d489f2d91 for instance 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 on user Apr 14 18:57:49 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-0d760d63-9331-4102-9a42-8e35336fc12d req-cb39e2b3-adf7-45c4-989e-7a6ee0623e2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032983 Apr 14 18:57:49 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 216/650] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:57:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:57:50 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-cd4e49db-19f1-4971-b455-92c9bd01b3d9 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:57:50 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-cd4e49db-19f1-4971-b455-92c9bd01b3d9 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:57:50 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:57:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-cd4e49db-19f1-4971-b455-92c9bd01b3d9 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-cd4e49db-19f1-4971-b455-92c9bd01b3d9 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-cd4e49db-19f1-4971-b455-92c9bd01b3d9 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-cd4e49db-19f1-4971-b455-92c9bd01b3d9 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-cd4e49db-19f1-4971-b455-92c9bd01b3d9 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-cd4e49db-19f1-4971-b455-92c9bd01b3d9 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:51 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-cd4e49db-19f1-4971-b455-92c9bd01b3d9 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8713ed85ffb4446847f5ded4bc2e399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60e8abd123e414f847c68ba72894689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:57:51 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-cd4e49db-19f1-4971-b455-92c9bd01b3d9 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d305ab4-1813-4728-a01c-287e521a05ec" status: 200 len: 1504 microversion: 2.1 time: 0.237396 Apr 14 18:57:51 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 221/651] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:57:50 2023] GET /compute/v2.1/servers/1d305ab4-1813-4728-a01c-287e521a05ec => generated 1504 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:57:51 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-8584d719-e324-42a3-96ed-980c1e275805 req-7ae0f63a-64e8-4b2e-ad78-ad6359a6d56f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1", "name": "network-vif-plugged", "status": "completed", "tag": "3a14f42c-2105-477c-8012-069d489f2d91"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:57:51 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-8584d719-e324-42a3-96ed-980c1e275805 req-7ae0f63a-64e8-4b2e-ad78-ad6359a6d56f service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:51 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-8584d719-e324-42a3-96ed-980c1e275805 req-7ae0f63a-64e8-4b2e-ad78-ad6359a6d56f service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:51 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-8584d719-e324-42a3-96ed-980c1e275805 req-7ae0f63a-64e8-4b2e-ad78-ad6359a6d56f service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:51 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-8584d719-e324-42a3-96ed-980c1e275805 req-7ae0f63a-64e8-4b2e-ad78-ad6359a6d56f service nova] Creating event network-vif-plugged:3a14f42c-2105-477c-8012-069d489f2d91 for instance 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 on user Apr 14 18:57:51 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-8584d719-e324-42a3-96ed-980c1e275805 req-7ae0f63a-64e8-4b2e-ad78-ad6359a6d56f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031385 Apr 14 18:57:51 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 215/652] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:57:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:57:59 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-a8187db9-7ec1-4455-ac70-48a463a7c240 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:57:59 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-a8187db9-7ec1-4455-ac70-48a463a7c240 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:57:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a8187db9-7ec1-4455-ac70-48a463a7c240 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a8187db9-7ec1-4455-ac70-48a463a7c240 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a8187db9-7ec1-4455-ac70-48a463a7c240 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a8187db9-7ec1-4455-ac70-48a463a7c240 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a8187db9-7ec1-4455-ac70-48a463a7c240 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a8187db9-7ec1-4455-ac70-48a463a7c240 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:59 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-a8187db9-7ec1-4455-ac70-48a463a7c240 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:57:59 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-a8187db9-7ec1-4455-ac70-48a463a7c240 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 200 len: 1721 microversion: 2.1 time: 0.298622 Apr 14 18:57:59 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 217/653] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:57:59 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 1721 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:57:59 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-14bc2ef7-50b9-441f-ac46-08fe1be4ec1c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:57:59 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-14bc2ef7-50b9-441f-ac46-08fe1be4ec1c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:57:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-14bc2ef7-50b9-441f-ac46-08fe1be4ec1c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-14bc2ef7-50b9-441f-ac46-08fe1be4ec1c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-14bc2ef7-50b9-441f-ac46-08fe1be4ec1c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-14bc2ef7-50b9-441f-ac46-08fe1be4ec1c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:57:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-14bc2ef7-50b9-441f-ac46-08fe1be4ec1c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:57:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-14bc2ef7-50b9-441f-ac46-08fe1be4ec1c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:57:59 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-14bc2ef7-50b9-441f-ac46-08fe1be4ec1c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:57:59 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-14bc2ef7-50b9-441f-ac46-08fe1be4ec1c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 200 len: 1721 microversion: 2.1 time: 0.151968 Apr 14 18:57:59 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 222/654] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:57:59 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:58:02 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:58:02 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:58:02 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-d46912d1-6458-4fc9-bdb5-9bc6c42a6d21 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:58:02 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-d46912d1-6458-4fc9-bdb5-9bc6c42a6d21 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:58:03 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d46912d1-6458-4fc9-bdb5-9bc6c42a6d21 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:03 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d46912d1-6458-4fc9-bdb5-9bc6c42a6d21 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:03 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d46912d1-6458-4fc9-bdb5-9bc6c42a6d21 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:03 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d46912d1-6458-4fc9-bdb5-9bc6c42a6d21 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:03 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d46912d1-6458-4fc9-bdb5-9bc6c42a6d21 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:03 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d46912d1-6458-4fc9-bdb5-9bc6c42a6d21 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:03 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-d46912d1-6458-4fc9-bdb5-9bc6c42a6d21 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052226 Apr 14 18:58:03 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 216/655] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:58:02 2023] GET /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 18:58:03 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-31c69de0-cf0e-4236-9f06-cf7f0039802f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:58:03 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-31c69de0-cf0e-4236-9f06-cf7f0039802f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:58:03 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:58:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-31c69de0-cf0e-4236-9f06-cf7f0039802f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-31c69de0-cf0e-4236-9f06-cf7f0039802f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-31c69de0-cf0e-4236-9f06-cf7f0039802f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-31c69de0-cf0e-4236-9f06-cf7f0039802f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-31c69de0-cf0e-4236-9f06-cf7f0039802f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:03 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-31c69de0-cf0e-4236-9f06-cf7f0039802f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:03 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-31c69de0-cf0e-4236-9f06-cf7f0039802f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] HTTP exception thrown: Instance cab14831-868c-40aa-b694-9e0185557653 is not attached to volume e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 Apr 14 18:58:03 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-31c69de0-cf0e-4236-9f06-cf7f0039802f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Request method failure captured: Apr 14 18:58:03 user devstack@n-api.service[61675]: request: DELETE /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653/os-volume_attachments/e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 HTTP/1.1 Apr 14 18:58:03 user devstack@n-api.service[61675]: Accept: application/json Apr 14 18:58:03 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 18:58:03 user devstack@n-api.service[61675]: Connection: close Apr 14 18:58:03 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 18:58:03 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 18:58:03 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 18:58:03 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 18:58:03 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 18:58:03 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOZ-jF2atbHM_lByU_PslMtdO0A0nVkr7kGVuQAm-akNwPFZSgKmoKfwLoWEfhrr5QMF2UgTOk5rIvzWw8k8iAfboO82nc4PwBwFuYK77brK2jiwQR--r0qVPIH2UN3sU9b27IssfwfkZMWqxZA_2E94J7fiHrT6oOA1O-1dwGEm2pZM Apr 14 18:58:03 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 18:58:03 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 18:58:03 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 18:58:03 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 18:58:03 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 18:58:03 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 18:58:03 user devstack@n-api.service[61675]: X-Project-Id: 8e6b4e98cf9e4f96b79c3288dfe0da89 Apr 14 18:58:03 user devstack@n-api.service[61675]: X-Project-Name: tempest-TestMinimumBasicScenario-1257841115 Apr 14 18:58:03 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 18:58:03 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 18:58:03 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8e6b4e98cf9e4f96b79c3288dfe0da89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8e6b4e98cf9e4f96b79c3288dfe0da89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8e6b4e98cf9e4f96b79c3288dfe0da89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:58:03 user devstack@n-api.service[61675]: X-Tenant: tempest-TestMinimumBasicScenario-1257841115 Apr 14 18:58:03 user devstack@n-api.service[61675]: X-Tenant-Id: 8e6b4e98cf9e4f96b79c3288dfe0da89 Apr 14 18:58:03 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1257841115 Apr 14 18:58:03 user devstack@n-api.service[61675]: X-User: tempest-TestMinimumBasicScenario-1257841115-project-member Apr 14 18:58:03 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 18:58:03 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 18:58:03 user devstack@n-api.service[61675]: X-User-Id: 67e1d31c2d9048699758779dedf7d3ac Apr 14 18:58:03 user devstack@n-api.service[61675]: X-User-Name: tempest-TestMinimumBasicScenario-1257841115-project-member Apr 14 18:58:03 user devstack@n-api.service[61675]: method: > Apr 14 18:58:03 user devstack@n-api.service[61675]: exception: Instance cab14831-868c-40aa-b694-9e0185557653 is not attached to volume e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 Apr 14 18:58:03 user devstack@n-api.service[61675]: action_args: {'server_id': 'cab14831-868c-40aa-b694-9e0185557653', 'id': 'e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7'} Apr 14 18:58:03 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7. Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cab14831-868c-40aa-b694-9e0185557653 is not attached to volume e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cab14831-868c-40aa-b694-9e0185557653 is not attached to volume e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 Apr 14 18:58:03 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:58:03 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-31c69de0-cf0e-4236-9f06-cf7f0039802f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Returning 404 to user: Instance cab14831-868c-40aa-b694-9e0185557653 is not attached to volume e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:58:03 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-31c69de0-cf0e-4236-9f06-cf7f0039802f tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653/os-volume_attachments/e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7" status: 404 len: 154 microversion: 2.1 time: 0.096173 Apr 14 18:58:03 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 218/656] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 18:58:03 2023] DELETE /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653/os-volume_attachments/e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:58:06 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-dbd50053-511f-4610-a3ea-8f0b06fcd999 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:58:06 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-dbd50053-511f-4610-a3ea-8f0b06fcd999 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:58:06 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=14 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:58:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-dbd50053-511f-4610-a3ea-8f0b06fcd999 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-dbd50053-511f-4610-a3ea-8f0b06fcd999 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-dbd50053-511f-4610-a3ea-8f0b06fcd999 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-dbd50053-511f-4610-a3ea-8f0b06fcd999 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-dbd50053-511f-4610-a3ea-8f0b06fcd999 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-dbd50053-511f-4610-a3ea-8f0b06fcd999 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:06 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-dbd50053-511f-4610-a3ea-8f0b06fcd999 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] HTTP exception thrown: Instance 8832a321-f1ac-411a-8fc9-1fc816bffec6 could not be found. Apr 14 18:58:06 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-dbd50053-511f-4610-a3ea-8f0b06fcd999 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Request method failure captured: Apr 14 18:58:06 user devstack@n-api.service[61674]: request: GET /compute/v2.1/servers/8832a321-f1ac-411a-8fc9-1fc816bffec6 HTTP/1.1 Apr 14 18:58:06 user devstack@n-api.service[61674]: Accept: application/json Apr 14 18:58:06 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 18:58:06 user devstack@n-api.service[61674]: Connection: close Apr 14 18:58:06 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 18:58:06 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 18:58:06 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 18:58:06 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 18:58:06 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 18:58:06 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOaEsY-49_UH_J3mBATqvRVH5dUHcsVSiiVJdSIid9MZeTcpfoMTIknXp2tWw93BGljD6LR0tbGadP9mZK4S9ZtkGPst8WCDv6cC5W-8OVcxLzEvEXPXvJgxmE3G7nRXzVSHsO49YGfr1T4QOGzRokkupbfGrjnTgHd_6oETan9GCdhM Apr 14 18:58:06 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 18:58:06 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 18:58:06 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 18:58:06 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 18:58:06 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 18:58:06 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 18:58:06 user devstack@n-api.service[61674]: X-Project-Id: 4af68184e7654efea3187e05bb10e5e4 Apr 14 18:58:06 user devstack@n-api.service[61674]: X-Project-Name: tempest-ServersNegativeTestJSON-1532814906 Apr 14 18:58:06 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 18:58:06 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 18:58:06 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4af68184e7654efea3187e05bb10e5e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4af68184e7654efea3187e05bb10e5e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4af68184e7654efea3187e05bb10e5e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:58:06 user devstack@n-api.service[61674]: X-Tenant: tempest-ServersNegativeTestJSON-1532814906 Apr 14 18:58:06 user devstack@n-api.service[61674]: X-Tenant-Id: 4af68184e7654efea3187e05bb10e5e4 Apr 14 18:58:06 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1532814906 Apr 14 18:58:06 user devstack@n-api.service[61674]: X-User: tempest-ServersNegativeTestJSON-1532814906-project-member Apr 14 18:58:06 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 18:58:06 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 18:58:06 user devstack@n-api.service[61674]: X-User-Id: 008a24026e844252b0be1268461bc2b1 Apr 14 18:58:06 user devstack@n-api.service[61674]: X-User-Name: tempest-ServersNegativeTestJSON-1532814906-project-member Apr 14 18:58:06 user devstack@n-api.service[61674]: method: > Apr 14 18:58:06 user devstack@n-api.service[61674]: exception: Instance 8832a321-f1ac-411a-8fc9-1fc816bffec6 could not be found. Apr 14 18:58:06 user devstack@n-api.service[61674]: action_args: {'id': '8832a321-f1ac-411a-8fc9-1fc816bffec6'} Apr 14 18:58:06 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8832a321-f1ac-411a-8fc9-1fc816bffec6 could not be found. Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8832a321-f1ac-411a-8fc9-1fc816bffec6 could not be found. Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8832a321-f1ac-411a-8fc9-1fc816bffec6 could not be found. Apr 14 18:58:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:58:06 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-dbd50053-511f-4610-a3ea-8f0b06fcd999 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Returning 404 to user: Instance 8832a321-f1ac-411a-8fc9-1fc816bffec6 could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:58:06 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-dbd50053-511f-4610-a3ea-8f0b06fcd999 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8832a321-f1ac-411a-8fc9-1fc816bffec6" status: 404 len: 111 microversion: 2.1 time: 0.032852 Apr 14 18:58:06 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 223/657] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:58:06 2023] GET /compute/v2.1/servers/8832a321-f1ac-411a-8fc9-1fc816bffec6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:58:06 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-58456fec-bb80-41cf-b38e-b0a620b50d5e tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:58:06 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-58456fec-bb80-41cf-b38e-b0a620b50d5e tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:58:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-58456fec-bb80-41cf-b38e-b0a620b50d5e tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-58456fec-bb80-41cf-b38e-b0a620b50d5e tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-58456fec-bb80-41cf-b38e-b0a620b50d5e tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-58456fec-bb80-41cf-b38e-b0a620b50d5e tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-58456fec-bb80-41cf-b38e-b0a620b50d5e tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-58456fec-bb80-41cf-b38e-b0a620b50d5e tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:07 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-58456fec-bb80-41cf-b38e-b0a620b50d5e tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008a24026e844252b0be1268461bc2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af68184e7654efea3187e05bb10e5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:58:07 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-58456fec-bb80-41cf-b38e-b0a620b50d5e tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97aafe40-5587-41cf-ba75-6077d9daa7eb" status: 200 len: 1494 microversion: 2.1 time: 0.249161 Apr 14 18:58:07 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 217/658] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:58:06 2023] GET /compute/v2.1/servers/97aafe40-5587-41cf-ba75-6077d9daa7eb => generated 1494 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:58:07 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:58:07 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:58:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:07 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=28 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:58:07 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Going to try to terminate instance {{(pid=61675) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 18:58:07 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653" status: 204 len: 0 microversion: 2.1 time: 0.132972 Apr 14 18:58:07 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 219/659] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 18:58:07 2023] DELETE /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 18:58:07 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-bf3322e4-269e-454f-a383-800aa46869b3 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:58:07 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-bf3322e4-269e-454f-a383-800aa46869b3 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:58:07 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bf3322e4-269e-454f-a383-800aa46869b3 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:07 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bf3322e4-269e-454f-a383-800aa46869b3 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:07 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bf3322e4-269e-454f-a383-800aa46869b3 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:07 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bf3322e4-269e-454f-a383-800aa46869b3 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:07 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bf3322e4-269e-454f-a383-800aa46869b3 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:07 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-bf3322e4-269e-454f-a383-800aa46869b3 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:07 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-bf3322e4-269e-454f-a383-800aa46869b3 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e1d31c2d9048699758779dedf7d3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6b4e98cf9e4f96b79c3288dfe0da89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:58:07 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-bf3322e4-269e-454f-a383-800aa46869b3 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653" status: 200 len: 1543 microversion: 2.1 time: 0.324212 Apr 14 18:58:07 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 224/660] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:58:07 2023] GET /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653 => generated 1543 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:58:07 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-6937fc0c-d034-48e1-9a0f-08843ee0ac21 req-1a668b39-66a7-47e4-8e45-3ea086becbe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab14831-868c-40aa-b694-9e0185557653", "name": "network-vif-unplugged", "status": "completed", "tag": "00582309-5b1a-4a4d-80b2-478c8f9ada29"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:58:07 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-6937fc0c-d034-48e1-9a0f-08843ee0ac21 req-1a668b39-66a7-47e4-8e45-3ea086becbe0 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:07 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-6937fc0c-d034-48e1-9a0f-08843ee0ac21 req-1a668b39-66a7-47e4-8e45-3ea086becbe0 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:07 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-6937fc0c-d034-48e1-9a0f-08843ee0ac21 req-1a668b39-66a7-47e4-8e45-3ea086becbe0 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:07 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-6937fc0c-d034-48e1-9a0f-08843ee0ac21 req-1a668b39-66a7-47e4-8e45-3ea086becbe0 service nova] Creating event network-vif-unplugged:00582309-5b1a-4a4d-80b2-478c8f9ada29 for instance cab14831-868c-40aa-b694-9e0185557653 on user Apr 14 18:58:07 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-6937fc0c-d034-48e1-9a0f-08843ee0ac21 req-1a668b39-66a7-47e4-8e45-3ea086becbe0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030258 Apr 14 18:58:07 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 218/661] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:58:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:58:09 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-0fb96fa9-867d-4789-bac3-96758c68e4d3 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:58:09 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-0fb96fa9-867d-4789-bac3-96758c68e4d3 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:58:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0fb96fa9-867d-4789-bac3-96758c68e4d3 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0fb96fa9-867d-4789-bac3-96758c68e4d3 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0fb96fa9-867d-4789-bac3-96758c68e4d3 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0fb96fa9-867d-4789-bac3-96758c68e4d3 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0fb96fa9-867d-4789-bac3-96758c68e4d3 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0fb96fa9-867d-4789-bac3-96758c68e4d3 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:09 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-0fb96fa9-867d-4789-bac3-96758c68e4d3 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f90c8f23e3b42a98fdb9261db65f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf25bcc0dea4d3eb1284e8995eb3466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:58:09 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-0fb96fa9-867d-4789-bac3-96758c68e4d3 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4" status: 200 len: 1643 microversion: 2.1 time: 0.242514 Apr 14 18:58:09 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 220/662] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:58:09 2023] GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4 => generated 1643 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:58:09 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-6fdb0486-015d-4a40-b434-cafb8067c5ea req-e61e497e-3f29-46a7-bbfd-8d7ec9919bbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab14831-868c-40aa-b694-9e0185557653", "name": "network-vif-plugged", "status": "completed", "tag": "00582309-5b1a-4a4d-80b2-478c8f9ada29"}, {"server_uuid": "cab14831-868c-40aa-b694-9e0185557653", "name": "network-vif-deleted", "tag": "00582309-5b1a-4a4d-80b2-478c8f9ada29"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:58:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6fdb0486-015d-4a40-b434-cafb8067c5ea req-e61e497e-3f29-46a7-bbfd-8d7ec9919bbc service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6fdb0486-015d-4a40-b434-cafb8067c5ea req-e61e497e-3f29-46a7-bbfd-8d7ec9919bbc service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:09 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6fdb0486-015d-4a40-b434-cafb8067c5ea req-e61e497e-3f29-46a7-bbfd-8d7ec9919bbc service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:10 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-6fdb0486-015d-4a40-b434-cafb8067c5ea req-e61e497e-3f29-46a7-bbfd-8d7ec9919bbc service nova] Creating event network-vif-plugged:00582309-5b1a-4a4d-80b2-478c8f9ada29 for instance cab14831-868c-40aa-b694-9e0185557653 on user Apr 14 18:58:10 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-6fdb0486-015d-4a40-b434-cafb8067c5ea req-e61e497e-3f29-46a7-bbfd-8d7ec9919bbc service nova] Creating event network-vif-deleted:00582309-5b1a-4a4d-80b2-478c8f9ada29 for instance cab14831-868c-40aa-b694-9e0185557653 on user Apr 14 18:58:10 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-6fdb0486-015d-4a40-b434-cafb8067c5ea req-e61e497e-3f29-46a7-bbfd-8d7ec9919bbc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032870 Apr 14 18:58:10 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 225/663] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:58:09 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:58:15 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-e5c4af57-dd7e-460f-802f-392627daac5d tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:58:15 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-e5c4af57-dd7e-460f-802f-392627daac5d tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:58:15 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e5c4af57-dd7e-460f-802f-392627daac5d tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:15 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e5c4af57-dd7e-460f-802f-392627daac5d tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:15 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e5c4af57-dd7e-460f-802f-392627daac5d tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:15 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e5c4af57-dd7e-460f-802f-392627daac5d tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:15 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e5c4af57-dd7e-460f-802f-392627daac5d tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:15 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e5c4af57-dd7e-460f-802f-392627daac5d tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:15 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-e5c4af57-dd7e-460f-802f-392627daac5d tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1feb4399-a5dc-43a7-ac78-4d22809e2737/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042141 Apr 14 18:58:15 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 219/664] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:58:15 2023] GET /compute/v2.1/servers/1feb4399-a5dc-43a7-ac78-4d22809e2737/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 18:58:15 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-a1e24d75-607a-438d-9929-7efbb070ede4 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:58:15 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-a1e24d75-607a-438d-9929-7efbb070ede4 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:58:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a1e24d75-607a-438d-9929-7efbb070ede4 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a1e24d75-607a-438d-9929-7efbb070ede4 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a1e24d75-607a-438d-9929-7efbb070ede4 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a1e24d75-607a-438d-9929-7efbb070ede4 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a1e24d75-607a-438d-9929-7efbb070ede4 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a1e24d75-607a-438d-9929-7efbb070ede4 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:15 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-a1e24d75-607a-438d-9929-7efbb070ede4 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] HTTP exception thrown: Instance a2a860bd-802f-4760-b77b-92b7ac4ad09b could not be found. Apr 14 18:58:15 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-a1e24d75-607a-438d-9929-7efbb070ede4 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Request method failure captured: Apr 14 18:58:15 user devstack@n-api.service[61675]: request: GET /compute/v2.1/servers/a2a860bd-802f-4760-b77b-92b7ac4ad09b HTTP/1.1 Apr 14 18:58:15 user devstack@n-api.service[61675]: Accept: application/json Apr 14 18:58:15 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 18:58:15 user devstack@n-api.service[61675]: Connection: close Apr 14 18:58:15 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 18:58:15 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 18:58:15 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 18:58:15 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 18:58:15 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 18:58:15 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOaCz_ZRs4dyZFttvuRtxh-VNTzIJQG3l58jt8mhXgFZd9xbCONtLDEVIHEtmZKZR5cX2QFBMdt5gwfiZMpIJufurfACLOPlzYVornrkzyx6U36qD6B514s2IDt0SV15mcWEqjrEFQaHe1DAoyil09uQGmgFjrg31CLnP6d9zwAitxqo Apr 14 18:58:15 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 18:58:15 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 18:58:15 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 18:58:15 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 18:58:15 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 18:58:15 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 18:58:15 user devstack@n-api.service[61675]: X-Project-Id: 46d0091007734312b8d33caf294d2c65 Apr 14 18:58:15 user devstack@n-api.service[61675]: X-Project-Name: tempest-TestShelveInstance-48517904 Apr 14 18:58:15 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 18:58:15 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 18:58:15 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/46d0091007734312b8d33caf294d2c65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/46d0091007734312b8d33caf294d2c65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/46d0091007734312b8d33caf294d2c65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:58:15 user devstack@n-api.service[61675]: X-Tenant: tempest-TestShelveInstance-48517904 Apr 14 18:58:15 user devstack@n-api.service[61675]: X-Tenant-Id: 46d0091007734312b8d33caf294d2c65 Apr 14 18:58:15 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-TestShelveInstance-48517904 Apr 14 18:58:15 user devstack@n-api.service[61675]: X-User: tempest-TestShelveInstance-48517904-project-member Apr 14 18:58:15 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 18:58:15 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 18:58:15 user devstack@n-api.service[61675]: X-User-Id: 10e3f2dda9bc49f48c66beb978dbdaca Apr 14 18:58:15 user devstack@n-api.service[61675]: X-User-Name: tempest-TestShelveInstance-48517904-project-member Apr 14 18:58:15 user devstack@n-api.service[61675]: method: > Apr 14 18:58:15 user devstack@n-api.service[61675]: exception: Instance a2a860bd-802f-4760-b77b-92b7ac4ad09b could not be found. Apr 14 18:58:15 user devstack@n-api.service[61675]: action_args: {'id': 'a2a860bd-802f-4760-b77b-92b7ac4ad09b'} Apr 14 18:58:15 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2a860bd-802f-4760-b77b-92b7ac4ad09b could not be found. Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2a860bd-802f-4760-b77b-92b7ac4ad09b could not be found. Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2a860bd-802f-4760-b77b-92b7ac4ad09b could not be found. Apr 14 18:58:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:58:15 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-a1e24d75-607a-438d-9929-7efbb070ede4 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Returning 404 to user: Instance a2a860bd-802f-4760-b77b-92b7ac4ad09b could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:58:15 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-a1e24d75-607a-438d-9929-7efbb070ede4 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2a860bd-802f-4760-b77b-92b7ac4ad09b" status: 404 len: 111 microversion: 2.1 time: 0.027919 Apr 14 18:58:15 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 221/665] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:58:15 2023] GET /compute/v2.1/servers/a2a860bd-802f-4760-b77b-92b7ac4ad09b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:58:15 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-35b2ee76-1868-44f8-8cb9-e9469bd63def tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Calling method '.version_select at 0x7fdae1063e20>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:58:15 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-35b2ee76-1868-44f8-8cb9-e9469bd63def tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-756134745" status: 202 len: 0 microversion: 2.1 time: 0.046758 Apr 14 18:58:15 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 226/666] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 18:58:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-756134745 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:58:18 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-387267343"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:58:18 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:58:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:18 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:19 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1feb4399-a5dc-43a7-ac78-4d22809e2737/action" status: 202 len: 0 microversion: 2.1 time: 0.867753 Apr 14 18:58:19 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 220/667] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 18:58:18 2023] POST /compute/v2.1/servers/1feb4399-a5dc-43a7-ac78-4d22809e2737/action => generated 0 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 18:58:24 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-1802316a-0742-4731-8b85-fb45a8df0035 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:58:24 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-1802316a-0742-4731-8b85-fb45a8df0035 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:58:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1802316a-0742-4731-8b85-fb45a8df0035 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1802316a-0742-4731-8b85-fb45a8df0035 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1802316a-0742-4731-8b85-fb45a8df0035 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1802316a-0742-4731-8b85-fb45a8df0035 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1802316a-0742-4731-8b85-fb45a8df0035 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1802316a-0742-4731-8b85-fb45a8df0035 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:24 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=30 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:58:24 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-97fc5a25-e3f9-435c-8d7a-6967f66c11ec tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:58:24 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-97fc5a25-e3f9-435c-8d7a-6967f66c11ec tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:58:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-97fc5a25-e3f9-435c-8d7a-6967f66c11ec tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-97fc5a25-e3f9-435c-8d7a-6967f66c11ec tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-97fc5a25-e3f9-435c-8d7a-6967f66c11ec tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-97fc5a25-e3f9-435c-8d7a-6967f66c11ec tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-97fc5a25-e3f9-435c-8d7a-6967f66c11ec tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-97fc5a25-e3f9-435c-8d7a-6967f66c11ec tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:24 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-1802316a-0742-4731-8b85-fb45a8df0035 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:58:24 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-1802316a-0742-4731-8b85-fb45a8df0035 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:58:24 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-1802316a-0742-4731-8b85-fb45a8df0035 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:58:24 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-1802316a-0742-4731-8b85-fb45a8df0035 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" status: 200 len: 1768 microversion: 2.87 time: 0.335458 Apr 14 18:58:24 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 222/668] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:58:24 2023] GET /compute/v2.1/servers/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 => generated 1768 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:58:24 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-97fc5a25-e3f9-435c-8d7a-6967f66c11ec tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.195782 Apr 14 18:58:24 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 227/669] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 18:58:24 2023] GET /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d/os-interface => generated 282 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 18:58:25 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-f1710d42-560e-41ae-bbdf-497e34230803 req-fbab37cf-8f77-40f8-b30f-40684823a6ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68af5668-55ba-4150-be95-b6861afc820d", "tag": "bdc608b2-229e-4fc9-a251-dbb53cafa70a"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:58:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-f1710d42-560e-41ae-bbdf-497e34230803 req-fbab37cf-8f77-40f8-b30f-40684823a6ef service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-f1710d42-560e-41ae-bbdf-497e34230803 req-fbab37cf-8f77-40f8-b30f-40684823a6ef service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-f1710d42-560e-41ae-bbdf-497e34230803 req-fbab37cf-8f77-40f8-b30f-40684823a6ef service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:25 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-f1710d42-560e-41ae-bbdf-497e34230803 req-fbab37cf-8f77-40f8-b30f-40684823a6ef service nova] Creating event network-changed:bdc608b2-229e-4fc9-a251-dbb53cafa70a for instance 68af5668-55ba-4150-be95-b6861afc820d on user Apr 14 18:58:25 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-f1710d42-560e-41ae-bbdf-497e34230803 req-fbab37cf-8f77-40f8-b30f-40684823a6ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042997 Apr 14 18:58:25 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 221/670] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:58:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:58:25 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-44c67bb6-dd94-4729-a858-bc72c76ea48b tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:58:25 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-44c67bb6-dd94-4729-a858-bc72c76ea48b tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:58:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-44c67bb6-dd94-4729-a858-bc72c76ea48b tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-44c67bb6-dd94-4729-a858-bc72c76ea48b tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-44c67bb6-dd94-4729-a858-bc72c76ea48b tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-44c67bb6-dd94-4729-a858-bc72c76ea48b tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-44c67bb6-dd94-4729-a858-bc72c76ea48b tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-44c67bb6-dd94-4729-a858-bc72c76ea48b tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:25 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-44c67bb6-dd94-4729-a858-bc72c76ea48b tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d/ips" status: 200 len: 107 microversion: 2.1 time: 0.039721 Apr 14 18:58:25 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 223/671] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 18:58:25 2023] GET /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d/ips => generated 107 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:58:28 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c74300f0-2575-455e-93c8-8de79d10c378"}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:58:28 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:58:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:28 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "POST /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.371938 Apr 14 18:58:28 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 228/672] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 18:58:28 2023] POST /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d/os-volume_attachments => generated 194 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:58:30 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1760181806", "imageRef": "b06b95d0-3f1e-4cfc-b707-9f58271dcb39", "flavorRef": "42", "key_name": "tempest-TestStampPattern-580300982", "security_groups": [{"name": "tempest-secgroup-smoke-1172081860"}], "networks": [{"uuid": "1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37"}]}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:58:30 user devstack@n-api.service[61673]: DEBUG nova.network.neutron [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] validate_networks() for [('1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37', None, None, None, None, None)] {{(pid=61673) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:58:31 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Flavor limits 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:58:31 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Image limits 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:58:31 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Flavor pref 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:58:31 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Image pref 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:58:31 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:58:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:31 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Getting quotas for project 921435d84194431c886ec1ed1848d4d6. Resources: {'ram', 'instances', 'cores'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:58:31 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Getting quotas for user 9a9414d0c24643fdb162aad828c736bd and project 921435d84194431c886ec1ed1848d4d6. Resources: {'ram', 'instances', 'cores'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:58:31 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Going to run 1 instances... {{(pid=61673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:58:31 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b06b95d0-3f1e-4cfc-b707-9f58271dcb39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:58:31 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.263832 Apr 14 18:58:31 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 222/673] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:58:30 2023] POST /compute/v2.1/servers => generated 404 bytes in 1265 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:58:31 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-28a1cf59-552b-4638-a8e1-63cec4a9d2a1 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:58:31 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-28a1cf59-552b-4638-a8e1-63cec4a9d2a1 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:58:32 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-28a1cf59-552b-4638-a8e1-63cec4a9d2a1 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a9414d0c24643fdb162aad828c736bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921435d84194431c886ec1ed1848d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:58:32 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-28a1cf59-552b-4638-a8e1-63cec4a9d2a1 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" status: 200 len: 1236 microversion: 2.1 time: 0.072839 Apr 14 18:58:32 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 224/674] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:58:31 2023] GET /compute/v2.1/servers/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 => generated 1236 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:58:32 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-ac545f1e-0406-4d21-927f-a1c283cc0b82 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:58:32 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-ac545f1e-0406-4d21-927f-a1c283cc0b82 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:58:32 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ac545f1e-0406-4d21-927f-a1c283cc0b82 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:32 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ac545f1e-0406-4d21-927f-a1c283cc0b82 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:32 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ac545f1e-0406-4d21-927f-a1c283cc0b82 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:32 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ac545f1e-0406-4d21-927f-a1c283cc0b82 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:32 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ac545f1e-0406-4d21-927f-a1c283cc0b82 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:32 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ac545f1e-0406-4d21-927f-a1c283cc0b82 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:32 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-ac545f1e-0406-4d21-927f-a1c283cc0b82 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] HTTP exception thrown: Instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508 could not be found. Apr 14 18:58:32 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-ac545f1e-0406-4d21-927f-a1c283cc0b82 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Request method failure captured: Apr 14 18:58:32 user devstack@n-api.service[61674]: request: GET /compute/v2.1/servers/bc9e21d7-f70e-41ea-8ab1-9014f93ad508 HTTP/1.1 Apr 14 18:58:32 user devstack@n-api.service[61674]: Accept: application/json Apr 14 18:58:32 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 18:58:32 user devstack@n-api.service[61674]: Connection: close Apr 14 18:58:32 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 18:58:32 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 18:58:32 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 18:58:32 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 18:58:32 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 18:58:32 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOaGjzEHP4gR4MoApqz0vJpRX2_SvaMHlWJEk_fU7mYw99OWl-qUsSQ6rEQ6kqDrRwocqp34lWfQib95-KwgiyuwPlyVpsmwfmwLReClbkEHff7utOAgEbSdfwWoPS9VLZQQ0SJcp_M6aCZY6cryOh5BrJ2VueTzigMFoaeOsa0D5fWA Apr 14 18:58:32 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 18:58:32 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 18:58:32 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 18:58:32 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 18:58:32 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 18:58:32 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 18:58:32 user devstack@n-api.service[61674]: X-Project-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 18:58:32 user devstack@n-api.service[61674]: X-Project-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 18:58:32 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 18:58:32 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 18:58:32 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:58:32 user devstack@n-api.service[61674]: X-Tenant: tempest-TestVolumeBootPattern-1560263906 Apr 14 18:58:32 user devstack@n-api.service[61674]: X-Tenant-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 18:58:32 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 18:58:32 user devstack@n-api.service[61674]: X-User: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 18:58:32 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 18:58:32 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 18:58:32 user devstack@n-api.service[61674]: X-User-Id: fc3bed70703a49c8bdec2f50193c7f70 Apr 14 18:58:32 user devstack@n-api.service[61674]: X-User-Name: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 18:58:32 user devstack@n-api.service[61674]: method: > Apr 14 18:58:32 user devstack@n-api.service[61674]: exception: Instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508 could not be found. Apr 14 18:58:32 user devstack@n-api.service[61674]: action_args: {'id': 'bc9e21d7-f70e-41ea-8ab1-9014f93ad508'} Apr 14 18:58:32 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508 could not be found. Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508 could not be found. Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508 could not be found. Apr 14 18:58:32 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:58:32 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-ac545f1e-0406-4d21-927f-a1c283cc0b82 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Returning 404 to user: Instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508 could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:58:32 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-ac545f1e-0406-4d21-927f-a1c283cc0b82 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc9e21d7-f70e-41ea-8ab1-9014f93ad508" status: 404 len: 111 microversion: 2.1 time: 0.042339 Apr 14 18:58:32 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 229/675] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:58:32 2023] GET /compute/v2.1/servers/bc9e21d7-f70e-41ea-8ab1-9014f93ad508 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 18:58:32 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-9c43d7a6-c9fa-4945-a6ac-fc1869ae9a72 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:58:32 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-9c43d7a6-c9fa-4945-a6ac-fc1869ae9a72 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:58:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9c43d7a6-c9fa-4945-a6ac-fc1869ae9a72 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9c43d7a6-c9fa-4945-a6ac-fc1869ae9a72 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9c43d7a6-c9fa-4945-a6ac-fc1869ae9a72 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9c43d7a6-c9fa-4945-a6ac-fc1869ae9a72 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9c43d7a6-c9fa-4945-a6ac-fc1869ae9a72 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9c43d7a6-c9fa-4945-a6ac-fc1869ae9a72 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:32 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-9c43d7a6-c9fa-4945-a6ac-fc1869ae9a72 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] HTTP exception thrown: Instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508 could not be found. Apr 14 18:58:32 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-9c43d7a6-c9fa-4945-a6ac-fc1869ae9a72 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Request method failure captured: Apr 14 18:58:32 user devstack@n-api.service[61673]: request: DELETE /compute/v2.1/servers/bc9e21d7-f70e-41ea-8ab1-9014f93ad508 HTTP/1.1 Apr 14 18:58:32 user devstack@n-api.service[61673]: Accept: application/json Apr 14 18:58:32 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 18:58:32 user devstack@n-api.service[61673]: Connection: close Apr 14 18:58:32 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 18:58:32 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 18:58:32 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 18:58:32 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 18:58:32 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 18:58:32 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOaGjzEHP4gR4MoApqz0vJpRX2_SvaMHlWJEk_fU7mYw99OWl-qUsSQ6rEQ6kqDrRwocqp34lWfQib95-KwgiyuwPlyVpsmwfmwLReClbkEHff7utOAgEbSdfwWoPS9VLZQQ0SJcp_M6aCZY6cryOh5BrJ2VueTzigMFoaeOsa0D5fWA Apr 14 18:58:32 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 18:58:32 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 18:58:32 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 18:58:32 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 18:58:32 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 18:58:32 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 18:58:32 user devstack@n-api.service[61673]: X-Project-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 18:58:32 user devstack@n-api.service[61673]: X-Project-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 18:58:32 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 18:58:32 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 18:58:32 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:58:32 user devstack@n-api.service[61673]: X-Tenant: tempest-TestVolumeBootPattern-1560263906 Apr 14 18:58:32 user devstack@n-api.service[61673]: X-Tenant-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 18:58:32 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 18:58:32 user devstack@n-api.service[61673]: X-User: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 18:58:32 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 18:58:32 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 18:58:32 user devstack@n-api.service[61673]: X-User-Id: fc3bed70703a49c8bdec2f50193c7f70 Apr 14 18:58:32 user devstack@n-api.service[61673]: X-User-Name: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 18:58:32 user devstack@n-api.service[61673]: method: > Apr 14 18:58:32 user devstack@n-api.service[61673]: exception: Instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508 could not be found. Apr 14 18:58:32 user devstack@n-api.service[61673]: action_args: {'id': 'bc9e21d7-f70e-41ea-8ab1-9014f93ad508'} Apr 14 18:58:32 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508 could not be found. Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508 could not be found. Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508 could not be found. Apr 14 18:58:32 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:58:32 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-9c43d7a6-c9fa-4945-a6ac-fc1869ae9a72 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Returning 404 to user: Instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508 could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:58:32 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-9c43d7a6-c9fa-4945-a6ac-fc1869ae9a72 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bc9e21d7-f70e-41ea-8ab1-9014f93ad508" status: 404 len: 111 microversion: 2.1 time: 0.056671 Apr 14 18:58:32 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 223/676] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 18:58:32 2023] DELETE /compute/v2.1/servers/bc9e21d7-f70e-41ea-8ab1-9014f93ad508 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:58:32 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-c0b087ac-83b2-4817-96b2-d5217e87918f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:58:32 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-c0b087ac-83b2-4817-96b2-d5217e87918f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:58:33 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:58:33 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c0b087ac-83b2-4817-96b2-d5217e87918f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:33 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c0b087ac-83b2-4817-96b2-d5217e87918f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:33 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c0b087ac-83b2-4817-96b2-d5217e87918f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:33 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c0b087ac-83b2-4817-96b2-d5217e87918f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:33 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c0b087ac-83b2-4817-96b2-d5217e87918f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:33 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c0b087ac-83b2-4817-96b2-d5217e87918f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:33 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-c0b087ac-83b2-4817-96b2-d5217e87918f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] HTTP exception thrown: Instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508 could not be found. Apr 14 18:58:33 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-c0b087ac-83b2-4817-96b2-d5217e87918f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Request method failure captured: Apr 14 18:58:33 user devstack@n-api.service[61675]: request: GET /compute/v2.1/servers/bc9e21d7-f70e-41ea-8ab1-9014f93ad508 HTTP/1.1 Apr 14 18:58:33 user devstack@n-api.service[61675]: Accept: application/json Apr 14 18:58:33 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 18:58:33 user devstack@n-api.service[61675]: Connection: close Apr 14 18:58:33 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 18:58:33 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 18:58:33 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 18:58:33 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 18:58:33 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 18:58:33 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOaGjzEHP4gR4MoApqz0vJpRX2_SvaMHlWJEk_fU7mYw99OWl-qUsSQ6rEQ6kqDrRwocqp34lWfQib95-KwgiyuwPlyVpsmwfmwLReClbkEHff7utOAgEbSdfwWoPS9VLZQQ0SJcp_M6aCZY6cryOh5BrJ2VueTzigMFoaeOsa0D5fWA Apr 14 18:58:33 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 18:58:33 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 18:58:33 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 18:58:33 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 18:58:33 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 18:58:33 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 18:58:33 user devstack@n-api.service[61675]: X-Project-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 18:58:33 user devstack@n-api.service[61675]: X-Project-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 18:58:33 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 18:58:33 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 18:58:33 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:58:33 user devstack@n-api.service[61675]: X-Tenant: tempest-TestVolumeBootPattern-1560263906 Apr 14 18:58:33 user devstack@n-api.service[61675]: X-Tenant-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 18:58:33 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 18:58:33 user devstack@n-api.service[61675]: X-User: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 18:58:33 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 18:58:33 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 18:58:33 user devstack@n-api.service[61675]: X-User-Id: fc3bed70703a49c8bdec2f50193c7f70 Apr 14 18:58:33 user devstack@n-api.service[61675]: X-User-Name: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 18:58:33 user devstack@n-api.service[61675]: method: > Apr 14 18:58:33 user devstack@n-api.service[61675]: exception: Instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508 could not be found. Apr 14 18:58:33 user devstack@n-api.service[61675]: action_args: {'id': 'bc9e21d7-f70e-41ea-8ab1-9014f93ad508'} Apr 14 18:58:33 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508 could not be found. Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508 could not be found. Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508 could not be found. Apr 14 18:58:33 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:58:33 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-c0b087ac-83b2-4817-96b2-d5217e87918f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Returning 404 to user: Instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508 could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:58:33 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-c0b087ac-83b2-4817-96b2-d5217e87918f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bc9e21d7-f70e-41ea-8ab1-9014f93ad508" status: 404 len: 111 microversion: 2.1 time: 0.255097 Apr 14 18:58:33 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 225/677] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:58:32 2023] GET /compute/v2.1/servers/bc9e21d7-f70e-41ea-8ab1-9014f93ad508 => generated 111 bytes in 256 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:58:36 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-f6050988-08c1-4949-868f-0d3a07e80ccb req-b610da98-4951-43cf-bd0f-b5fca016ec5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58", "tag": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:58:36 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-f6050988-08c1-4949-868f-0d3a07e80ccb req-b610da98-4951-43cf-bd0f-b5fca016ec5b service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:36 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-f6050988-08c1-4949-868f-0d3a07e80ccb req-b610da98-4951-43cf-bd0f-b5fca016ec5b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:36 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-f6050988-08c1-4949-868f-0d3a07e80ccb req-b610da98-4951-43cf-bd0f-b5fca016ec5b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:36 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-f6050988-08c1-4949-868f-0d3a07e80ccb req-b610da98-4951-43cf-bd0f-b5fca016ec5b service nova] Creating event network-changed:9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 for instance 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 on user Apr 14 18:58:36 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-f6050988-08c1-4949-868f-0d3a07e80ccb req-b610da98-4951-43cf-bd0f-b5fca016ec5b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057827 Apr 14 18:58:36 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 230/678] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:58:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:58:37 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:58:37 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:58:37 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:58:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:37 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:58:38 user devstack@n-api.service[61673]: DEBUG nova.objects.instance [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lazy-loading 'services' on Instance uuid 68af5668-55ba-4150-be95-b6861afc820d {{(pid=61673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 18:58:38 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d/os-volume_attachments/c74300f0-2575-455e-93c8-8de79d10c378" status: 202 len: 0 microversion: 2.1 time: 0.391477 Apr 14 18:58:38 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 224/679] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 18:58:37 2023] DELETE /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d/os-volume_attachments/c74300f0-2575-455e-93c8-8de79d10c378 => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:58:38 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-806fd90a-4348-4d6d-bd85-3ef1a0cc7d98 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:58:38 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-806fd90a-4348-4d6d-bd85-3ef1a0cc7d98 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:58:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-806fd90a-4348-4d6d-bd85-3ef1a0cc7d98 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-806fd90a-4348-4d6d-bd85-3ef1a0cc7d98 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-806fd90a-4348-4d6d-bd85-3ef1a0cc7d98 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-806fd90a-4348-4d6d-bd85-3ef1a0cc7d98 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-806fd90a-4348-4d6d-bd85-3ef1a0cc7d98 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-806fd90a-4348-4d6d-bd85-3ef1a0cc7d98 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:38 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:58:38 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-806fd90a-4348-4d6d-bd85-3ef1a0cc7d98 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075981 Apr 14 18:58:38 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 226/680] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:58:38 2023] GET /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:58:38 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-b153d6d5-c345-4853-8e34-8532e11703a3 req-2479520a-084e-4548-a219-be886d81872a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58", "name": "network-vif-plugged", "status": "completed", "tag": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:58:38 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:58:38 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-b153d6d5-c345-4853-8e34-8532e11703a3 req-2479520a-084e-4548-a219-be886d81872a service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:38 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-b153d6d5-c345-4853-8e34-8532e11703a3 req-2479520a-084e-4548-a219-be886d81872a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:38 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-b153d6d5-c345-4853-8e34-8532e11703a3 req-2479520a-084e-4548-a219-be886d81872a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:38 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-b153d6d5-c345-4853-8e34-8532e11703a3 req-2479520a-084e-4548-a219-be886d81872a service nova] Creating event network-vif-plugged:9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 for instance 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 on user Apr 14 18:58:38 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-b153d6d5-c345-4853-8e34-8532e11703a3 req-2479520a-084e-4548-a219-be886d81872a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041717 Apr 14 18:58:38 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 231/681] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:58:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:58:40 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-5a16d76f-27db-41ee-8475-f462bca1319a req-a015906a-3272-42ea-b74f-b04503b18618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58", "name": "network-vif-plugged", "status": "completed", "tag": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:58:40 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-5a16d76f-27db-41ee-8475-f462bca1319a req-a015906a-3272-42ea-b74f-b04503b18618 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:40 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-5a16d76f-27db-41ee-8475-f462bca1319a req-a015906a-3272-42ea-b74f-b04503b18618 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:40 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-5a16d76f-27db-41ee-8475-f462bca1319a req-a015906a-3272-42ea-b74f-b04503b18618 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:40 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-5a16d76f-27db-41ee-8475-f462bca1319a req-a015906a-3272-42ea-b74f-b04503b18618 service nova] Creating event network-vif-plugged:9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 for instance 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 on user Apr 14 18:58:40 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-5a16d76f-27db-41ee-8475-f462bca1319a req-a015906a-3272-42ea-b74f-b04503b18618 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041481 Apr 14 18:58:40 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 225/682] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:58:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:58:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-889981772", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "84ea013c-1c59-46c4-b9be-9feb9dd5409d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70"}]}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:58:47 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:58:47 user devstack@n-api.service[61675]: DEBUG nova.network.neutron [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] validate_networks() for [('bfa4fdbb-10b3-4715-9ff2-b717d052cc70', None, None, None, None, None)] {{(pid=61675) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:58:47 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flavor limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:58:47 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Image limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:58:47 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flavor pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:58:47 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Image pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:58:47 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:58:47 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:47 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:47 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:47 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:47 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:47 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:47 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Getting quotas for project 72d2bf68325a4a18934a8403571c24bb. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:58:47 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Getting quotas for user fc3bed70703a49c8bdec2f50193c7f70 and project 72d2bf68325a4a18934a8403571c24bb. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:58:47 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Going to run 1 instances... {{(pid=61675) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:58:47 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='84ea013c-1c59-46c4-b9be-9feb9dd5409d',volume_size=None,volume_type=None)] {{(pid=61675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:58:47 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.788549 Apr 14 18:58:47 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 227/683] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:58:46 2023] POST /compute/v2.1/servers => generated 378 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:58:47 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-0034f64c-1a6d-4b38-b2e8-606d5c96304d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:58:47 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-0034f64c-1a6d-4b38-b2e8-606d5c96304d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:58:47 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-0034f64c-1a6d-4b38-b2e8-606d5c96304d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:58:47 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-0034f64c-1a6d-4b38-b2e8-606d5c96304d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56097076-1e63-41ba-8331-be8ede06c537" status: 200 len: 1065 microversion: 2.1 time: 0.074682 Apr 14 18:58:47 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 232/684] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:58:47 2023] GET /compute/v2.1/servers/56097076-1e63-41ba-8331-be8ede06c537 => generated 1065 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:58:51 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:58:51 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=6 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:58:51 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=3 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:58:51 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=10,nova_cell1:INSERT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:58:51 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-200a5428-121b-48e2-bb21-54d3a7b6b19d req-dec97a09-7061-4383-b02e-4b27c9136336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56097076-1e63-41ba-8331-be8ede06c537", "tag": "f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:58:51 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-200a5428-121b-48e2-bb21-54d3a7b6b19d req-dec97a09-7061-4383-b02e-4b27c9136336 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:51 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-200a5428-121b-48e2-bb21-54d3a7b6b19d req-dec97a09-7061-4383-b02e-4b27c9136336 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:51 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-200a5428-121b-48e2-bb21-54d3a7b6b19d req-dec97a09-7061-4383-b02e-4b27c9136336 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:51 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-200a5428-121b-48e2-bb21-54d3a7b6b19d req-dec97a09-7061-4383-b02e-4b27c9136336 service nova] Creating event network-changed:f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a for instance 56097076-1e63-41ba-8331-be8ede06c537 on user Apr 14 18:58:51 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-200a5428-121b-48e2-bb21-54d3a7b6b19d req-dec97a09-7061-4383-b02e-4b27c9136336 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038932 Apr 14 18:58:51 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 226/685] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:58:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:58:54 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-02e9de82-833b-46ad-9d8b-c0c6767dfe1e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Action: 'create', calling method: .version_select at 0x7fdae0de16c0>, body: {"keypair": {"name": "tempest-keypair-126127202", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsV7S4Lu7EScb7Ca1HXXWHMkfNibGLUsHaVxGGFEiPOu+DZdxz7O+eYdDkk0eqIIMAOS8zIzZ1Dx0oJrzQLMfBVS8ZQb5vqX9QOfeUkQuI1qS8pmjCXzIvfDogAaOvDEA=="}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:58:54 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-02e9de82-833b-46ad-9d8b-c0c6767dfe1e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Getting quotas for project e60e8abd123e414f847c68ba72894689. Resources: {'key_pairs'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:58:54 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-02e9de82-833b-46ad-9d8b-c0c6767dfe1e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Getting quotas for user c8713ed85ffb4446847f5ded4bc2e399 and project e60e8abd123e414f847c68ba72894689. Resources: {'key_pairs'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:58:54 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-02e9de82-833b-46ad-9d8b-c0c6767dfe1e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049082 Apr 14 18:58:54 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 228/686] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 18:58:54 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:58:57 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-878359626", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "fc7fb9bf-ad17-4427-9165-d2b68830357a"}], "security_groups": [{"name": "tempest-securitygroup--692282981"}], "key_name": "tempest-keypair-126127202", "user_data": "}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:58:57 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:58:57 user devstack@n-api.service[61674]: DEBUG nova.network.neutron [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] validate_networks() for [('fc7fb9bf-ad17-4427-9165-d2b68830357a', None, None, None, None, None)] {{(pid=61674) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:58:57 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Flavor limits 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:58:57 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Image limits 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:58:57 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Flavor pref 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:58:57 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Image pref 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:58:57 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:58:57 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:57 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:57 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:57 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:57 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:57 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:57 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Getting quotas for project e60e8abd123e414f847c68ba72894689. Resources: {'ram', 'instances', 'cores'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:58:57 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Getting quotas for user c8713ed85ffb4446847f5ded4bc2e399 and project e60e8abd123e414f847c68ba72894689. Resources: {'ram', 'instances', 'cores'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:58:57 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Going to run 1 instances... {{(pid=61674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:58:57 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:58:57 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.666188 Apr 14 18:58:57 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 233/687] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:58:57 2023] POST /compute/v2.1/servers => generated 406 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:58:57 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-ec939241-50c4-4492-aab1-4a97a42019af tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:58:57 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-ec939241-50c4-4492-aab1-4a97a42019af tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:58:57 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-ec939241-50c4-4492-aab1-4a97a42019af tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8713ed85ffb4446847f5ded4bc2e399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60e8abd123e414f847c68ba72894689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:58:57 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-ec939241-50c4-4492-aab1-4a97a42019af tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58" status: 200 len: 1238 microversion: 2.1 time: 0.099243 Apr 14 18:58:57 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 227/688] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:58:57 2023] GET /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58 => generated 1238 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:58:57 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:58:57 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=7 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:58:57 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-62b5c935-1125-49a1-ba28-a5e4bd98205d tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:58:57 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-62b5c935-1125-49a1-ba28-a5e4bd98205d tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:58:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-62b5c935-1125-49a1-ba28-a5e4bd98205d tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-62b5c935-1125-49a1-ba28-a5e4bd98205d tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-62b5c935-1125-49a1-ba28-a5e4bd98205d tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-62b5c935-1125-49a1-ba28-a5e4bd98205d tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-62b5c935-1125-49a1-ba28-a5e4bd98205d tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-62b5c935-1125-49a1-ba28-a5e4bd98205d tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:58 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-62b5c935-1125-49a1-ba28-a5e4bd98205d tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] HTTP exception thrown: Instance cab14831-868c-40aa-b694-9e0185557653 could not be found. Apr 14 18:58:58 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-62b5c935-1125-49a1-ba28-a5e4bd98205d tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Request method failure captured: Apr 14 18:58:58 user devstack@n-api.service[61675]: request: GET /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653 HTTP/1.1 Apr 14 18:58:58 user devstack@n-api.service[61675]: Accept: application/json Apr 14 18:58:58 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 18:58:58 user devstack@n-api.service[61675]: Connection: close Apr 14 18:58:58 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 18:58:58 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 18:58:58 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 18:58:58 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 18:58:58 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 18:58:58 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOZ-jF2atbHM_lByU_PslMtdO0A0nVkr7kGVuQAm-akNwPFZSgKmoKfwLoWEfhrr5QMF2UgTOk5rIvzWw8k8iAfboO82nc4PwBwFuYK77brK2jiwQR--r0qVPIH2UN3sU9b27IssfwfkZMWqxZA_2E94J7fiHrT6oOA1O-1dwGEm2pZM Apr 14 18:58:58 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 18:58:58 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 18:58:58 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 18:58:58 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 18:58:58 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 18:58:58 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 18:58:58 user devstack@n-api.service[61675]: X-Project-Id: 8e6b4e98cf9e4f96b79c3288dfe0da89 Apr 14 18:58:58 user devstack@n-api.service[61675]: X-Project-Name: tempest-TestMinimumBasicScenario-1257841115 Apr 14 18:58:58 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 18:58:58 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 18:58:58 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8e6b4e98cf9e4f96b79c3288dfe0da89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8e6b4e98cf9e4f96b79c3288dfe0da89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8e6b4e98cf9e4f96b79c3288dfe0da89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:58:58 user devstack@n-api.service[61675]: X-Tenant: tempest-TestMinimumBasicScenario-1257841115 Apr 14 18:58:58 user devstack@n-api.service[61675]: X-Tenant-Id: 8e6b4e98cf9e4f96b79c3288dfe0da89 Apr 14 18:58:58 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1257841115 Apr 14 18:58:58 user devstack@n-api.service[61675]: X-User: tempest-TestMinimumBasicScenario-1257841115-project-member Apr 14 18:58:58 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 18:58:58 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 18:58:58 user devstack@n-api.service[61675]: X-User-Id: 67e1d31c2d9048699758779dedf7d3ac Apr 14 18:58:58 user devstack@n-api.service[61675]: X-User-Name: tempest-TestMinimumBasicScenario-1257841115-project-member Apr 14 18:58:58 user devstack@n-api.service[61675]: method: > Apr 14 18:58:58 user devstack@n-api.service[61675]: exception: Instance cab14831-868c-40aa-b694-9e0185557653 could not be found. Apr 14 18:58:58 user devstack@n-api.service[61675]: action_args: {'id': 'cab14831-868c-40aa-b694-9e0185557653'} Apr 14 18:58:58 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cab14831-868c-40aa-b694-9e0185557653 could not be found. Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cab14831-868c-40aa-b694-9e0185557653 could not be found. Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cab14831-868c-40aa-b694-9e0185557653 could not be found. Apr 14 18:58:58 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:58:58 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-62b5c935-1125-49a1-ba28-a5e4bd98205d tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Returning 404 to user: Instance cab14831-868c-40aa-b694-9e0185557653 could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:58:58 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-62b5c935-1125-49a1-ba28-a5e4bd98205d tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653" status: 404 len: 111 microversion: 2.1 time: 0.037148 Apr 14 18:58:58 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 229/689] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:58:57 2023] GET /compute/v2.1/servers/cab14831-868c-40aa-b694-9e0185557653 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:58:58 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-e08fa69e-22a8-45c4-af2c-33f7b143dc47 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Calling method '.version_select at 0x7fdae0f3ef80>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:58:58 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-e08fa69e-22a8-45c4-af2c-33f7b143dc47 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1594101407" status: 202 len: 0 microversion: 2.1 time: 0.021573 Apr 14 18:58:58 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 234/690] 10.0.0.210 () {62 vars in 1349 bytes} [Fri Apr 14 18:58:58 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1594101407 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:58:59 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:58:59 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:58:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:59 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Going to try to terminate instance {{(pid=61673) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 18:58:59 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 204 len: 0 microversion: 2.1 time: 0.174341 Apr 14 18:58:59 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 228/691] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 18:58:59 2023] DELETE /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 18:58:59 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-01ee9464-1307-472f-874e-65a566443eaf tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:58:59 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-01ee9464-1307-472f-874e-65a566443eaf tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:58:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-01ee9464-1307-472f-874e-65a566443eaf tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-01ee9464-1307-472f-874e-65a566443eaf tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-01ee9464-1307-472f-874e-65a566443eaf tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:58:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-01ee9464-1307-472f-874e-65a566443eaf tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:58:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-01ee9464-1307-472f-874e-65a566443eaf tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:58:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-01ee9464-1307-472f-874e-65a566443eaf tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:00 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-6f1dc242-1ca0-4cd1-a5ed-8c11b83f1fb8 req-f40e37dc-639d-4a53-baa9-dabf70dd8cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56097076-1e63-41ba-8331-be8ede06c537", "name": "network-vif-plugged", "status": "completed", "tag": "f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:59:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6f1dc242-1ca0-4cd1-a5ed-8c11b83f1fb8 req-f40e37dc-639d-4a53-baa9-dabf70dd8cec service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6f1dc242-1ca0-4cd1-a5ed-8c11b83f1fb8 req-f40e37dc-639d-4a53-baa9-dabf70dd8cec service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6f1dc242-1ca0-4cd1-a5ed-8c11b83f1fb8 req-f40e37dc-639d-4a53-baa9-dabf70dd8cec service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:00 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-6f1dc242-1ca0-4cd1-a5ed-8c11b83f1fb8 req-f40e37dc-639d-4a53-baa9-dabf70dd8cec service nova] Creating event network-vif-plugged:f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a for instance 56097076-1e63-41ba-8331-be8ede06c537 on user Apr 14 18:59:00 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-6f1dc242-1ca0-4cd1-a5ed-8c11b83f1fb8 req-f40e37dc-639d-4a53-baa9-dabf70dd8cec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038892 Apr 14 18:59:00 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 235/692] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:59:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:59:00 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-01ee9464-1307-472f-874e-65a566443eaf tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:59:00 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-01ee9464-1307-472f-874e-65a566443eaf tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 200 len: 1727 microversion: 2.1 time: 0.588266 Apr 14 18:59:00 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 230/693] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:58:59 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 1727 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:59:00 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-01f2d25d-163b-4a12-b247-17fc92a39f51 req-4ffb4a77-194c-47ad-87d8-5742bc9e2ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05891511-e84c-4fe3-a688-edcc27849d58", "tag": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:59:00 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-01f2d25d-163b-4a12-b247-17fc92a39f51 req-4ffb4a77-194c-47ad-87d8-5742bc9e2ef8 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:00 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-01f2d25d-163b-4a12-b247-17fc92a39f51 req-4ffb4a77-194c-47ad-87d8-5742bc9e2ef8 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:00 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-01f2d25d-163b-4a12-b247-17fc92a39f51 req-4ffb4a77-194c-47ad-87d8-5742bc9e2ef8 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:00 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-01f2d25d-163b-4a12-b247-17fc92a39f51 req-4ffb4a77-194c-47ad-87d8-5742bc9e2ef8 service nova] Creating event network-changed:dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance 05891511-e84c-4fe3-a688-edcc27849d58 on user Apr 14 18:59:00 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-01f2d25d-163b-4a12-b247-17fc92a39f51 req-4ffb4a77-194c-47ad-87d8-5742bc9e2ef8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034638 Apr 14 18:59:00 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 229/694] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:59:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:59:02 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-0cc785cf-b506-47ee-b64c-cd9c8ff8e12c req-b5e16302-6fde-4ba5-8ece-7e56b4ef4914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56097076-1e63-41ba-8331-be8ede06c537", "name": "network-vif-plugged", "status": "completed", "tag": "f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a"}, {"server_uuid": "aa09363f-435d-4fa8-9f11-db0c3f4e08be", "name": "network-vif-unplugged", "status": "completed", "tag": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620"}, {"server_uuid": "aa09363f-435d-4fa8-9f11-db0c3f4e08be", "name": "network-vif-plugged", "status": "completed", "tag": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:59:02 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-0cc785cf-b506-47ee-b64c-cd9c8ff8e12c req-b5e16302-6fde-4ba5-8ece-7e56b4ef4914 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:02 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-0cc785cf-b506-47ee-b64c-cd9c8ff8e12c req-b5e16302-6fde-4ba5-8ece-7e56b4ef4914 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:02 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-0cc785cf-b506-47ee-b64c-cd9c8ff8e12c req-b5e16302-6fde-4ba5-8ece-7e56b4ef4914 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:02 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-0cc785cf-b506-47ee-b64c-cd9c8ff8e12c req-b5e16302-6fde-4ba5-8ece-7e56b4ef4914 service nova] Creating event network-vif-plugged:f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a for instance 56097076-1e63-41ba-8331-be8ede06c537 on user Apr 14 18:59:02 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-0cc785cf-b506-47ee-b64c-cd9c8ff8e12c req-b5e16302-6fde-4ba5-8ece-7e56b4ef4914 service nova] Creating event network-vif-unplugged:2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance aa09363f-435d-4fa8-9f11-db0c3f4e08be on user Apr 14 18:59:02 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-0cc785cf-b506-47ee-b64c-cd9c8ff8e12c req-b5e16302-6fde-4ba5-8ece-7e56b4ef4914 service nova] Creating event network-vif-plugged:2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance aa09363f-435d-4fa8-9f11-db0c3f4e08be on user Apr 14 18:59:02 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-0cc785cf-b506-47ee-b64c-cd9c8ff8e12c req-b5e16302-6fde-4ba5-8ece-7e56b4ef4914 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.041253 Apr 14 18:59:02 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 236/695] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:59:02 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:59:02 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-8dbdfff1-b1fb-435a-83df-571c864b996a req-deebf96d-5a88-4520-add9-429d9bd6c879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa09363f-435d-4fa8-9f11-db0c3f4e08be", "name": "network-vif-deleted", "tag": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:59:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-8dbdfff1-b1fb-435a-83df-571c864b996a req-deebf96d-5a88-4520-add9-429d9bd6c879 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-8dbdfff1-b1fb-435a-83df-571c864b996a req-deebf96d-5a88-4520-add9-429d9bd6c879 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-8dbdfff1-b1fb-435a-83df-571c864b996a req-deebf96d-5a88-4520-add9-429d9bd6c879 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:02 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-8dbdfff1-b1fb-435a-83df-571c864b996a req-deebf96d-5a88-4520-add9-429d9bd6c879 service nova] Creating event network-vif-deleted:2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance aa09363f-435d-4fa8-9f11-db0c3f4e08be on user Apr 14 18:59:02 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-8dbdfff1-b1fb-435a-83df-571c864b996a req-deebf96d-5a88-4520-add9-429d9bd6c879 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042010 Apr 14 18:59:02 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 231/696] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:59:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:59:02 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-83a39602-8d87-426c-a10b-6fc875f8ea0a req-2c3d1fba-6635-42f6-b4f4-e9b9d886578d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05891511-e84c-4fe3-a688-edcc27849d58", "name": "network-vif-plugged", "status": "completed", "tag": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:59:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-83a39602-8d87-426c-a10b-6fc875f8ea0a req-2c3d1fba-6635-42f6-b4f4-e9b9d886578d service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-83a39602-8d87-426c-a10b-6fc875f8ea0a req-2c3d1fba-6635-42f6-b4f4-e9b9d886578d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-83a39602-8d87-426c-a10b-6fc875f8ea0a req-2c3d1fba-6635-42f6-b4f4-e9b9d886578d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:02 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-83a39602-8d87-426c-a10b-6fc875f8ea0a req-2c3d1fba-6635-42f6-b4f4-e9b9d886578d service nova] Creating event network-vif-plugged:dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance 05891511-e84c-4fe3-a688-edcc27849d58 on user Apr 14 18:59:02 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-83a39602-8d87-426c-a10b-6fc875f8ea0a req-2c3d1fba-6635-42f6-b4f4-e9b9d886578d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037211 Apr 14 18:59:02 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 230/697] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:59:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:59:04 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-99c83b97-3143-462d-be41-6f41c5cdea78 req-417534c1-0306-45dc-84c7-302b381cf9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05891511-e84c-4fe3-a688-edcc27849d58", "name": "network-vif-plugged", "status": "completed", "tag": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:59:04 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-99c83b97-3143-462d-be41-6f41c5cdea78 req-417534c1-0306-45dc-84c7-302b381cf9e5 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:04 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-99c83b97-3143-462d-be41-6f41c5cdea78 req-417534c1-0306-45dc-84c7-302b381cf9e5 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:04 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-99c83b97-3143-462d-be41-6f41c5cdea78 req-417534c1-0306-45dc-84c7-302b381cf9e5 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:05 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-99c83b97-3143-462d-be41-6f41c5cdea78 req-417534c1-0306-45dc-84c7-302b381cf9e5 service nova] Creating event network-vif-plugged:dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance 05891511-e84c-4fe3-a688-edcc27849d58 on user Apr 14 18:59:05 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-99c83b97-3143-462d-be41-6f41c5cdea78 req-417534c1-0306-45dc-84c7-302b381cf9e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039639 Apr 14 18:59:05 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 237/698] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:59:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:59:09 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=10 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:59:09 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:59:09 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=4 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:59:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:09 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Going to try to start instance {{(pid=61675) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 14 18:59:09 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/action" status: 202 len: 0 microversion: 2.1 time: 0.080401 Apr 14 18:59:09 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 232/699] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 18:59:09 2023] POST /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 18:59:09 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:59:09 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-e9e5acf4-5430-4ddb-82b4-3afd613ba01e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:59:09 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-e9e5acf4-5430-4ddb-82b4-3afd613ba01e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:59:09 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e9e5acf4-5430-4ddb-82b4-3afd613ba01e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:09 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e9e5acf4-5430-4ddb-82b4-3afd613ba01e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:09 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e9e5acf4-5430-4ddb-82b4-3afd613ba01e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:09 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e9e5acf4-5430-4ddb-82b4-3afd613ba01e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:09 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e9e5acf4-5430-4ddb-82b4-3afd613ba01e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:09 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e9e5acf4-5430-4ddb-82b4-3afd613ba01e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:10 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-e9e5acf4-5430-4ddb-82b4-3afd613ba01e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f90c8f23e3b42a98fdb9261db65f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf25bcc0dea4d3eb1284e8995eb3466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:59:10 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-e9e5acf4-5430-4ddb-82b4-3afd613ba01e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4" status: 200 len: 1652 microversion: 2.1 time: 0.291184 Apr 14 18:59:10 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 231/700] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:59:09 2023] GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4 => generated 1652 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:59:10 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:59:10 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=8 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:59:10 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-341aa9a2-f2f3-4670-af8d-7e23d62acd8d tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1511641202", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "bdd3a85e-28f8-403e-b70f-ed9f27b4a1fa", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "7c02047b-1b40-4937-ac05-13accc969b21"}]}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:59:10 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-341aa9a2-f2f3-4670-af8d-7e23d62acd8d tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] HTTP exception thrown: Block Device bdd3a85e-28f8-403e-b70f-ed9f27b4a1fa is not bootable. Apr 14 18:59:10 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-341aa9a2-f2f3-4670-af8d-7e23d62acd8d tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Request method failure captured: Apr 14 18:59:10 user devstack@n-api.service[61674]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 14 18:59:10 user devstack@n-api.service[61674]: Accept: application/json Apr 14 18:59:10 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 18:59:10 user devstack@n-api.service[61674]: Connection: close Apr 14 18:59:10 user devstack@n-api.service[61674]: Content-Length: 357 Apr 14 18:59:10 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 18:59:10 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 18:59:10 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 18:59:10 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 18:59:10 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOaEsY-49_UH_J3mBATqvRVH5dUHcsVSiiVJdSIid9MZeTcpfoMTIknXp2tWw93BGljD6LR0tbGadP9mZK4S9ZtkGPst8WCDv6cC5W-8OVcxLzEvEXPXvJgxmE3G7nRXzVSHsO49YGfr1T4QOGzRokkupbfGrjnTgHd_6oETan9GCdhM Apr 14 18:59:10 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 18:59:10 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 18:59:10 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 18:59:10 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 18:59:10 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 18:59:10 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 18:59:10 user devstack@n-api.service[61674]: X-Project-Id: 4af68184e7654efea3187e05bb10e5e4 Apr 14 18:59:10 user devstack@n-api.service[61674]: X-Project-Name: tempest-ServersNegativeTestJSON-1532814906 Apr 14 18:59:10 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 18:59:10 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 18:59:10 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4af68184e7654efea3187e05bb10e5e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4af68184e7654efea3187e05bb10e5e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4af68184e7654efea3187e05bb10e5e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:59:10 user devstack@n-api.service[61674]: X-Tenant: tempest-ServersNegativeTestJSON-1532814906 Apr 14 18:59:10 user devstack@n-api.service[61674]: X-Tenant-Id: 4af68184e7654efea3187e05bb10e5e4 Apr 14 18:59:10 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1532814906 Apr 14 18:59:10 user devstack@n-api.service[61674]: X-User: tempest-ServersNegativeTestJSON-1532814906-project-member Apr 14 18:59:10 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 18:59:10 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 18:59:10 user devstack@n-api.service[61674]: X-User-Id: 008a24026e844252b0be1268461bc2b1 Apr 14 18:59:10 user devstack@n-api.service[61674]: X-User-Name: tempest-ServersNegativeTestJSON-1532814906-project-member Apr 14 18:59:10 user devstack@n-api.service[61674]: Apr 14 18:59:10 user devstack@n-api.service[61674]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1511641202", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "bdd3a85e-28f8-403e-b70f-ed9f27b4a1fa", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "7c02047b-1b40-4937-ac05-13accc969b21"}]}} Apr 14 18:59:10 user devstack@n-api.service[61674]: method: > Apr 14 18:59:10 user devstack@n-api.service[61674]: exception: Block Device bdd3a85e-28f8-403e-b70f-ed9f27b4a1fa is not bootable. Apr 14 18:59:10 user devstack@n-api.service[61674]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1511641202', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'bdd3a85e-28f8-403e-b70f-ed9f27b4a1fa'}], 'networks': [{'uuid': '7c02047b-1b40-4937-ac05-13accc969b21'}]}}} Apr 14 18:59:10 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device bdd3a85e-28f8-403e-b70f-ed9f27b4a1fa is not bootable. Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device bdd3a85e-28f8-403e-b70f-ed9f27b4a1fa is not bootable. Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device bdd3a85e-28f8-403e-b70f-ed9f27b4a1fa is not bootable. Apr 14 18:59:10 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:59:10 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-341aa9a2-f2f3-4670-af8d-7e23d62acd8d tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Returning 400 to user: Block Device bdd3a85e-28f8-403e-b70f-ed9f27b4a1fa is not bootable. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:59:10 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-341aa9a2-f2f3-4670-af8d-7e23d62acd8d tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.084057 Apr 14 18:59:10 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 238/701] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:59:10 2023] POST /compute/v2.1/servers => generated 110 bytes in 86 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 18:59:10 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-2e728b12-899f-41c0-b588-209d761a1094 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:59:10 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-2e728b12-899f-41c0-b588-209d761a1094 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:59:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2e728b12-899f-41c0-b588-209d761a1094 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2e728b12-899f-41c0-b588-209d761a1094 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2e728b12-899f-41c0-b588-209d761a1094 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2e728b12-899f-41c0-b588-209d761a1094 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2e728b12-899f-41c0-b588-209d761a1094 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:10 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2e728b12-899f-41c0-b588-209d761a1094 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:10 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-2e728b12-899f-41c0-b588-209d761a1094 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008a24026e844252b0be1268461bc2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af68184e7654efea3187e05bb10e5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:59:10 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-2e728b12-899f-41c0-b588-209d761a1094 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97aafe40-5587-41cf-ba75-6077d9daa7eb" status: 200 len: 1494 microversion: 2.1 time: 0.255721 Apr 14 18:59:10 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 233/702] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:59:10 2023] GET /compute/v2.1/servers/97aafe40-5587-41cf-ba75-6077d9daa7eb => generated 1494 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:59:13 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-ef870443-93d5-4f8a-8733-c345fe7940cd req-33efe537-51fc-45e7-8d7c-702b25ec6551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0050e6bb-0b53-4fdc-8437-16b94ee79fa4", "name": "network-vif-plugged", "status": "completed", "tag": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:59:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-ef870443-93d5-4f8a-8733-c345fe7940cd req-33efe537-51fc-45e7-8d7c-702b25ec6551 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-ef870443-93d5-4f8a-8733-c345fe7940cd req-33efe537-51fc-45e7-8d7c-702b25ec6551 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-ef870443-93d5-4f8a-8733-c345fe7940cd req-33efe537-51fc-45e7-8d7c-702b25ec6551 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:13 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-ef870443-93d5-4f8a-8733-c345fe7940cd req-33efe537-51fc-45e7-8d7c-702b25ec6551 service nova] Creating event network-vif-plugged:2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 on user Apr 14 18:59:13 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-ef870443-93d5-4f8a-8733-c345fe7940cd req-33efe537-51fc-45e7-8d7c-702b25ec6551 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047823 Apr 14 18:59:13 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 232/703] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:59:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:59:15 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=8 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:59:15 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-1791ec26-0d90-4609-b711-db13eb996dc1 req-eec06436-97d4-4514-8eff-8312dd5efefc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0050e6bb-0b53-4fdc-8437-16b94ee79fa4", "name": "network-vif-plugged", "status": "completed", "tag": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:59:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-1791ec26-0d90-4609-b711-db13eb996dc1 req-eec06436-97d4-4514-8eff-8312dd5efefc service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-1791ec26-0d90-4609-b711-db13eb996dc1 req-eec06436-97d4-4514-8eff-8312dd5efefc service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-1791ec26-0d90-4609-b711-db13eb996dc1 req-eec06436-97d4-4514-8eff-8312dd5efefc service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:15 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-1791ec26-0d90-4609-b711-db13eb996dc1 req-eec06436-97d4-4514-8eff-8312dd5efefc service nova] Creating event network-vif-plugged:2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 on user Apr 14 18:59:15 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-1791ec26-0d90-4609-b711-db13eb996dc1 req-eec06436-97d4-4514-8eff-8312dd5efefc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041411 Apr 14 18:59:15 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 239/704] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:59:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:59:22 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-ce4d7a80-2cb2-49d8-9e36-d3467e489619 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:59:22 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-ce4d7a80-2cb2-49d8-9e36-d3467e489619 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:59:22 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=3 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:59:22 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:59:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ce4d7a80-2cb2-49d8-9e36-d3467e489619 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ce4d7a80-2cb2-49d8-9e36-d3467e489619 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ce4d7a80-2cb2-49d8-9e36-d3467e489619 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ce4d7a80-2cb2-49d8-9e36-d3467e489619 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ce4d7a80-2cb2-49d8-9e36-d3467e489619 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ce4d7a80-2cb2-49d8-9e36-d3467e489619 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:22 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-ce4d7a80-2cb2-49d8-9e36-d3467e489619 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a9414d0c24643fdb162aad828c736bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921435d84194431c886ec1ed1848d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:59:22 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-ce4d7a80-2cb2-49d8-9e36-d3467e489619 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" status: 200 len: 1537 microversion: 2.1 time: 0.241404 Apr 14 18:59:22 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 234/705] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:59:22 2023] GET /compute/v2.1/servers/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 => generated 1537 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:59:25 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "38668399-fef1-4faf-adc6-9795d25acf37"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:59:25 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:59:25 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:59:25 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:59:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:25 user devstack@n-api.service[61673]: DEBUG nova.objects.instance [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lazy-loading 'flavor' on Instance uuid 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 {{(pid=61673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 18:59:25 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1/action" status: 200 len: 29 microversion: 2.87 time: 0.612467 Apr 14 18:59:25 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 233/706] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 18:59:25 2023] POST /compute/v2.1/servers/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1/action => generated 29 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:59:25 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:59:25 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:59:25 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-fb6b0679-bca5-4c5b-8f99-fc7876654f47 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:59:25 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-fb6b0679-bca5-4c5b-8f99-fc7876654f47 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:59:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fb6b0679-bca5-4c5b-8f99-fc7876654f47 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fb6b0679-bca5-4c5b-8f99-fc7876654f47 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fb6b0679-bca5-4c5b-8f99-fc7876654f47 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fb6b0679-bca5-4c5b-8f99-fc7876654f47 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fb6b0679-bca5-4c5b-8f99-fc7876654f47 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fb6b0679-bca5-4c5b-8f99-fc7876654f47 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:26 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-fb6b0679-bca5-4c5b-8f99-fc7876654f47 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:59:26 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-fb6b0679-bca5-4c5b-8f99-fc7876654f47 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:59:26 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-fb6b0679-bca5-4c5b-8f99-fc7876654f47 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:59:26 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-fb6b0679-bca5-4c5b-8f99-fc7876654f47 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" status: 200 len: 1774 microversion: 2.87 time: 0.280563 Apr 14 18:59:26 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 240/707] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 18:59:25 2023] GET /compute/v2.1/servers/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 => generated 1774 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 18:59:26 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-d5400cc5-0263-4812-a1fa-6898eb4e42af req-696430ba-926e-4f0d-bbed-bed0c1de3459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1", "name": "network-vif-unplugged", "status": "completed", "tag": "3a14f42c-2105-477c-8012-069d489f2d91"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:59:26 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-d5400cc5-0263-4812-a1fa-6898eb4e42af req-696430ba-926e-4f0d-bbed-bed0c1de3459 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:26 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-d5400cc5-0263-4812-a1fa-6898eb4e42af req-696430ba-926e-4f0d-bbed-bed0c1de3459 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:26 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-d5400cc5-0263-4812-a1fa-6898eb4e42af req-696430ba-926e-4f0d-bbed-bed0c1de3459 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:26 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-d5400cc5-0263-4812-a1fa-6898eb4e42af req-696430ba-926e-4f0d-bbed-bed0c1de3459 service nova] Creating event network-vif-unplugged:3a14f42c-2105-477c-8012-069d489f2d91 for instance 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 on user Apr 14 18:59:26 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-d5400cc5-0263-4812-a1fa-6898eb4e42af req-696430ba-926e-4f0d-bbed-bed0c1de3459 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037059 Apr 14 18:59:26 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 235/708] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:59:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:59:28 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-87d09cef-0983-4a81-bf47-c736476b23aa tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:59:28 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-87d09cef-0983-4a81-bf47-c736476b23aa tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:59:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-87d09cef-0983-4a81-bf47-c736476b23aa tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-87d09cef-0983-4a81-bf47-c736476b23aa tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-87d09cef-0983-4a81-bf47-c736476b23aa tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-87d09cef-0983-4a81-bf47-c736476b23aa tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-87d09cef-0983-4a81-bf47-c736476b23aa tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-87d09cef-0983-4a81-bf47-c736476b23aa tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:28 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-87d09cef-0983-4a81-bf47-c736476b23aa tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045763 Apr 14 18:59:28 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 234/709] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:59:28 2023] GET /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 18:59:28 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:59:28 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:59:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:28 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Going to try to terminate instance {{(pid=61674) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 18:59:28 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d" status: 204 len: 0 microversion: 2.1 time: 0.205148 Apr 14 18:59:28 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 241/710] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 18:59:28 2023] DELETE /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 18:59:28 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-d1785ff8-2369-467b-83c2-eda13cb67b28 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:59:28 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-d1785ff8-2369-467b-83c2-eda13cb67b28 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:59:28 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d1785ff8-2369-467b-83c2-eda13cb67b28 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:28 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d1785ff8-2369-467b-83c2-eda13cb67b28 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:28 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d1785ff8-2369-467b-83c2-eda13cb67b28 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:28 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d1785ff8-2369-467b-83c2-eda13cb67b28 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:28 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d1785ff8-2369-467b-83c2-eda13cb67b28 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:28 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d1785ff8-2369-467b-83c2-eda13cb67b28 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:28 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-6c92ea6e-3ecc-47a3-b958-45ce415969a7 req-632ae1bd-847d-4115-9fe6-75dcfd6bbb2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1", "name": "network-vif-plugged", "status": "completed", "tag": "3a14f42c-2105-477c-8012-069d489f2d91"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:59:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-6c92ea6e-3ecc-47a3-b958-45ce415969a7 req-632ae1bd-847d-4115-9fe6-75dcfd6bbb2a service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-6c92ea6e-3ecc-47a3-b958-45ce415969a7 req-632ae1bd-847d-4115-9fe6-75dcfd6bbb2a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-6c92ea6e-3ecc-47a3-b958-45ce415969a7 req-632ae1bd-847d-4115-9fe6-75dcfd6bbb2a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:28 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-6c92ea6e-3ecc-47a3-b958-45ce415969a7 req-632ae1bd-847d-4115-9fe6-75dcfd6bbb2a service nova] Creating event network-vif-plugged:3a14f42c-2105-477c-8012-069d489f2d91 for instance 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 on user Apr 14 18:59:28 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-6c92ea6e-3ecc-47a3-b958-45ce415969a7 req-632ae1bd-847d-4115-9fe6-75dcfd6bbb2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035373 Apr 14 18:59:28 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 235/711] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:59:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:59:29 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-d1785ff8-2369-467b-83c2-eda13cb67b28 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d53edaffb8f4038abd366d7942c6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34cdebcd7154988a957deae140e8eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:59:29 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-d1785ff8-2369-467b-83c2-eda13cb67b28 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d" status: 200 len: 1669 microversion: 2.1 time: 0.348405 Apr 14 18:59:29 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 236/712] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:59:28 2023] GET /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d => generated 1669 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:59:29 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-1f047927-69d5-458f-9d72-294e49893b52 req-d4e70e54-1582-408d-9b70-59f0f3d729b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68af5668-55ba-4150-be95-b6861afc820d", "name": "network-vif-unplugged", "status": "completed", "tag": "bdc608b2-229e-4fc9-a251-dbb53cafa70a"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:59:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-1f047927-69d5-458f-9d72-294e49893b52 req-d4e70e54-1582-408d-9b70-59f0f3d729b3 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-1f047927-69d5-458f-9d72-294e49893b52 req-d4e70e54-1582-408d-9b70-59f0f3d729b3 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-1f047927-69d5-458f-9d72-294e49893b52 req-d4e70e54-1582-408d-9b70-59f0f3d729b3 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:29 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-1f047927-69d5-458f-9d72-294e49893b52 req-d4e70e54-1582-408d-9b70-59f0f3d729b3 service nova] Creating event network-vif-unplugged:bdc608b2-229e-4fc9-a251-dbb53cafa70a for instance 68af5668-55ba-4150-be95-b6861afc820d on user Apr 14 18:59:29 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-1f047927-69d5-458f-9d72-294e49893b52 req-d4e70e54-1582-408d-9b70-59f0f3d729b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053426 Apr 14 18:59:29 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 242/713] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:59:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:59:30 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-9ad1cbc5-baa6-495e-835b-244948945ca3 req-1f913a68-a299-49f3-b271-777fe274b3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68af5668-55ba-4150-be95-b6861afc820d", "name": "network-vif-deleted", "tag": "bdc608b2-229e-4fc9-a251-dbb53cafa70a"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:59:30 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9ad1cbc5-baa6-495e-835b-244948945ca3 req-1f913a68-a299-49f3-b271-777fe274b3b1 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:30 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9ad1cbc5-baa6-495e-835b-244948945ca3 req-1f913a68-a299-49f3-b271-777fe274b3b1 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:30 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9ad1cbc5-baa6-495e-835b-244948945ca3 req-1f913a68-a299-49f3-b271-777fe274b3b1 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:30 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-9ad1cbc5-baa6-495e-835b-244948945ca3 req-1f913a68-a299-49f3-b271-777fe274b3b1 service nova] Creating event network-vif-deleted:bdc608b2-229e-4fc9-a251-dbb53cafa70a for instance 68af5668-55ba-4150-be95-b6861afc820d on user Apr 14 18:59:30 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-9ad1cbc5-baa6-495e-835b-244948945ca3 req-1f913a68-a299-49f3-b271-777fe274b3b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037860 Apr 14 18:59:30 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 236/714] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:59:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:59:30 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-5398eed7-53a1-41ac-8c94-b84d34875595 req-755b7060-20c8-46b9-ac7c-6d2cd9608531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1", "name": "network-vif-plugged", "status": "completed", "tag": "3a14f42c-2105-477c-8012-069d489f2d91"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:59:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-5398eed7-53a1-41ac-8c94-b84d34875595 req-755b7060-20c8-46b9-ac7c-6d2cd9608531 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-5398eed7-53a1-41ac-8c94-b84d34875595 req-755b7060-20c8-46b9-ac7c-6d2cd9608531 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-5398eed7-53a1-41ac-8c94-b84d34875595 req-755b7060-20c8-46b9-ac7c-6d2cd9608531 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:31 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-5398eed7-53a1-41ac-8c94-b84d34875595 req-755b7060-20c8-46b9-ac7c-6d2cd9608531 service nova] Creating event network-vif-plugged:3a14f42c-2105-477c-8012-069d489f2d91 for instance 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 on user Apr 14 18:59:31 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-5398eed7-53a1-41ac-8c94-b84d34875595 req-755b7060-20c8-46b9-ac7c-6d2cd9608531 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035988 Apr 14 18:59:31 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 237/715] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:59:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:59:31 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-7bda9428-06ca-406d-95c8-2224c1c4fe9d req-3a2852a7-a156-4b55-b6f9-0e4b015831e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68af5668-55ba-4150-be95-b6861afc820d", "name": "network-vif-plugged", "status": "completed", "tag": "bdc608b2-229e-4fc9-a251-dbb53cafa70a"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:59:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-7bda9428-06ca-406d-95c8-2224c1c4fe9d req-3a2852a7-a156-4b55-b6f9-0e4b015831e6 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-7bda9428-06ca-406d-95c8-2224c1c4fe9d req-3a2852a7-a156-4b55-b6f9-0e4b015831e6 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-7bda9428-06ca-406d-95c8-2224c1c4fe9d req-3a2852a7-a156-4b55-b6f9-0e4b015831e6 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:31 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-7bda9428-06ca-406d-95c8-2224c1c4fe9d req-3a2852a7-a156-4b55-b6f9-0e4b015831e6 service nova] Creating event network-vif-plugged:bdc608b2-229e-4fc9-a251-dbb53cafa70a for instance 68af5668-55ba-4150-be95-b6861afc820d on user Apr 14 18:59:31 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-7bda9428-06ca-406d-95c8-2224c1c4fe9d req-3a2852a7-a156-4b55-b6f9-0e4b015831e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031400 Apr 14 18:59:31 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 243/716] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:59:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:59:33 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-9f62b9b9-7ad9-47ad-9cff-0baccdbe50d5 req-0a403ba2-8c0d-4e92-ad07-6b3540ce5a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1", "name": "network-vif-plugged", "status": "completed", "tag": "3a14f42c-2105-477c-8012-069d489f2d91"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:59:33 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9f62b9b9-7ad9-47ad-9cff-0baccdbe50d5 req-0a403ba2-8c0d-4e92-ad07-6b3540ce5a12 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:33 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9f62b9b9-7ad9-47ad-9cff-0baccdbe50d5 req-0a403ba2-8c0d-4e92-ad07-6b3540ce5a12 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:33 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9f62b9b9-7ad9-47ad-9cff-0baccdbe50d5 req-0a403ba2-8c0d-4e92-ad07-6b3540ce5a12 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:33 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-9f62b9b9-7ad9-47ad-9cff-0baccdbe50d5 req-0a403ba2-8c0d-4e92-ad07-6b3540ce5a12 service nova] Creating event network-vif-plugged:3a14f42c-2105-477c-8012-069d489f2d91 for instance 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 on user Apr 14 18:59:33 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-9f62b9b9-7ad9-47ad-9cff-0baccdbe50d5 req-0a403ba2-8c0d-4e92-ad07-6b3540ce5a12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039755 Apr 14 18:59:33 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 237/717] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:59:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:59:37 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-a8ec7d7e-4a0a-4f8f-8102-53beec4de6f5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:59:37 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-a8ec7d7e-4a0a-4f8f-8102-53beec4de6f5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:59:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a8ec7d7e-4a0a-4f8f-8102-53beec4de6f5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a8ec7d7e-4a0a-4f8f-8102-53beec4de6f5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a8ec7d7e-4a0a-4f8f-8102-53beec4de6f5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a8ec7d7e-4a0a-4f8f-8102-53beec4de6f5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a8ec7d7e-4a0a-4f8f-8102-53beec4de6f5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:37 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a8ec7d7e-4a0a-4f8f-8102-53beec4de6f5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:38 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-a8ec7d7e-4a0a-4f8f-8102-53beec4de6f5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:59:38 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-a8ec7d7e-4a0a-4f8f-8102-53beec4de6f5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56097076-1e63-41ba-8331-be8ede06c537" status: 200 len: 1391 microversion: 2.1 time: 0.303412 Apr 14 18:59:38 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 238/718] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:59:37 2023] GET /compute/v2.1/servers/56097076-1e63-41ba-8331-be8ede06c537 => generated 1391 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:59:47 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:59:47 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:59:47 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-23d9d72d-3406-426f-94ab-7810450f7e96 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:59:47 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-23d9d72d-3406-426f-94ab-7810450f7e96 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:59:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-23d9d72d-3406-426f-94ab-7810450f7e96 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-23d9d72d-3406-426f-94ab-7810450f7e96 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-23d9d72d-3406-426f-94ab-7810450f7e96 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-23d9d72d-3406-426f-94ab-7810450f7e96 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-23d9d72d-3406-426f-94ab-7810450f7e96 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-23d9d72d-3406-426f-94ab-7810450f7e96 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:48 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-23d9d72d-3406-426f-94ab-7810450f7e96 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8713ed85ffb4446847f5ded4bc2e399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60e8abd123e414f847c68ba72894689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:59:48 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-23d9d72d-3406-426f-94ab-7810450f7e96 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58" status: 200 len: 1551 microversion: 2.1 time: 0.225392 Apr 14 18:59:48 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 244/719] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:59:47 2023] GET /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58 => generated 1551 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:59:50 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=10 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:59:50 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:59:50 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-f1023660-b53b-4b85-b750-7249f0aa1641 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:59:50 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-f1023660-b53b-4b85-b750-7249f0aa1641 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:59:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f1023660-b53b-4b85-b750-7249f0aa1641 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f1023660-b53b-4b85-b750-7249f0aa1641 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f1023660-b53b-4b85-b750-7249f0aa1641 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f1023660-b53b-4b85-b750-7249f0aa1641 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f1023660-b53b-4b85-b750-7249f0aa1641 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f1023660-b53b-4b85-b750-7249f0aa1641 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:50 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-f1023660-b53b-4b85-b750-7249f0aa1641 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] HTTP exception thrown: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. Apr 14 18:59:50 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-f1023660-b53b-4b85-b750-7249f0aa1641 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Request method failure captured: Apr 14 18:59:50 user devstack@n-api.service[61673]: request: GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be HTTP/1.1 Apr 14 18:59:50 user devstack@n-api.service[61673]: Accept: application/json Apr 14 18:59:50 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 18:59:50 user devstack@n-api.service[61673]: Connection: close Apr 14 18:59:50 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 18:59:50 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 18:59:50 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 18:59:50 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 18:59:50 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 18:59:50 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOZ9tFQYzH-U4RXmRE_GBoSoFEKSavu1XrGPWcT-lLfWHZbvzWQQWjWk59HjQ1Ma0lTR2YMhCPS0AAOW5m4ixuYIAB7rIJDTkb3oWnMUTJ4Uv-ETUGbIaxeHZCMtexw9UCn-fsw1BljHz-gqw0vXC9BSP_BSd7HFV75kPj8WIUaZxMdo Apr 14 18:59:50 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 18:59:50 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 18:59:50 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 18:59:50 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 18:59:50 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 18:59:50 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 18:59:50 user devstack@n-api.service[61673]: X-Project-Id: f028a79640b848228dc6e654a0eef49b Apr 14 18:59:50 user devstack@n-api.service[61673]: X-Project-Name: tempest-ServerActionsTestJSON-2112054326 Apr 14 18:59:50 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 18:59:50 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 18:59:50 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:59:50 user devstack@n-api.service[61673]: X-Tenant: tempest-ServerActionsTestJSON-2112054326 Apr 14 18:59:50 user devstack@n-api.service[61673]: X-Tenant-Id: f028a79640b848228dc6e654a0eef49b Apr 14 18:59:50 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-ServerActionsTestJSON-2112054326 Apr 14 18:59:50 user devstack@n-api.service[61673]: X-User: tempest-ServerActionsTestJSON-2112054326-project-member Apr 14 18:59:50 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 18:59:50 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 18:59:50 user devstack@n-api.service[61673]: X-User-Id: 55fa4abe2fdd48cb91f39bf8156a7793 Apr 14 18:59:50 user devstack@n-api.service[61673]: X-User-Name: tempest-ServerActionsTestJSON-2112054326-project-member Apr 14 18:59:50 user devstack@n-api.service[61673]: method: > Apr 14 18:59:50 user devstack@n-api.service[61673]: exception: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. Apr 14 18:59:50 user devstack@n-api.service[61673]: action_args: {'id': 'aa09363f-435d-4fa8-9f11-db0c3f4e08be'} Apr 14 18:59:50 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. Apr 14 18:59:50 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 18:59:50 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-f1023660-b53b-4b85-b750-7249f0aa1641 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Returning 404 to user: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:59:50 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-f1023660-b53b-4b85-b750-7249f0aa1641 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 404 len: 111 microversion: 2.1 time: 0.037436 Apr 14 18:59:50 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 238/720] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:59:50 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:59:50 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-b71afd5d-fd9b-439a-ab2d-f83f1ed4c2a6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:59:50 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-b71afd5d-fd9b-439a-ab2d-f83f1ed4c2a6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:59:50 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=10 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:59:50 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=22 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 18:59:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b71afd5d-fd9b-439a-ab2d-f83f1ed4c2a6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b71afd5d-fd9b-439a-ab2d-f83f1ed4c2a6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b71afd5d-fd9b-439a-ab2d-f83f1ed4c2a6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b71afd5d-fd9b-439a-ab2d-f83f1ed4c2a6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b71afd5d-fd9b-439a-ab2d-f83f1ed4c2a6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b71afd5d-fd9b-439a-ab2d-f83f1ed4c2a6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:50 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-b71afd5d-fd9b-439a-ab2d-f83f1ed4c2a6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] HTTP exception thrown: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. Apr 14 18:59:50 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-b71afd5d-fd9b-439a-ab2d-f83f1ed4c2a6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Request method failure captured: Apr 14 18:59:50 user devstack@n-api.service[61675]: request: GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be/os-volume_attachments HTTP/1.1 Apr 14 18:59:50 user devstack@n-api.service[61675]: Accept: application/json Apr 14 18:59:50 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 18:59:50 user devstack@n-api.service[61675]: Connection: close Apr 14 18:59:50 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 18:59:50 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 18:59:50 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 18:59:50 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 18:59:50 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 18:59:50 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOZ9tFQYzH-U4RXmRE_GBoSoFEKSavu1XrGPWcT-lLfWHZbvzWQQWjWk59HjQ1Ma0lTR2YMhCPS0AAOW5m4ixuYIAB7rIJDTkb3oWnMUTJ4Uv-ETUGbIaxeHZCMtexw9UCn-fsw1BljHz-gqw0vXC9BSP_BSd7HFV75kPj8WIUaZxMdo Apr 14 18:59:50 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 18:59:50 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 18:59:50 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 18:59:50 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 18:59:50 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 18:59:50 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 18:59:50 user devstack@n-api.service[61675]: X-Project-Id: f028a79640b848228dc6e654a0eef49b Apr 14 18:59:50 user devstack@n-api.service[61675]: X-Project-Name: tempest-ServerActionsTestJSON-2112054326 Apr 14 18:59:50 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 18:59:50 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 18:59:50 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:59:50 user devstack@n-api.service[61675]: X-Tenant: tempest-ServerActionsTestJSON-2112054326 Apr 14 18:59:50 user devstack@n-api.service[61675]: X-Tenant-Id: f028a79640b848228dc6e654a0eef49b Apr 14 18:59:50 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-ServerActionsTestJSON-2112054326 Apr 14 18:59:50 user devstack@n-api.service[61675]: X-User: tempest-ServerActionsTestJSON-2112054326-project-member Apr 14 18:59:50 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 18:59:50 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 18:59:50 user devstack@n-api.service[61675]: X-User-Id: 55fa4abe2fdd48cb91f39bf8156a7793 Apr 14 18:59:50 user devstack@n-api.service[61675]: X-User-Name: tempest-ServerActionsTestJSON-2112054326-project-member Apr 14 18:59:50 user devstack@n-api.service[61675]: method: > Apr 14 18:59:50 user devstack@n-api.service[61675]: exception: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. Apr 14 18:59:50 user devstack@n-api.service[61675]: action_args: {'server_id': 'aa09363f-435d-4fa8-9f11-db0c3f4e08be'} Apr 14 18:59:50 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. Apr 14 18:59:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 18:59:50 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-b71afd5d-fd9b-439a-ab2d-f83f1ed4c2a6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Returning 404 to user: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:59:50 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-b71afd5d-fd9b-439a-ab2d-f83f1ed4c2a6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031978 Apr 14 18:59:50 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 239/721] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 18:59:50 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:59:50 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-8baa4a44-be4f-4316-9fc2-20f8ff38f6fe tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:59:50 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-8baa4a44-be4f-4316-9fc2-20f8ff38f6fe tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:59:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8baa4a44-be4f-4316-9fc2-20f8ff38f6fe tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8baa4a44-be4f-4316-9fc2-20f8ff38f6fe tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8baa4a44-be4f-4316-9fc2-20f8ff38f6fe tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8baa4a44-be4f-4316-9fc2-20f8ff38f6fe tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8baa4a44-be4f-4316-9fc2-20f8ff38f6fe tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8baa4a44-be4f-4316-9fc2-20f8ff38f6fe tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:50 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-8baa4a44-be4f-4316-9fc2-20f8ff38f6fe tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] HTTP exception thrown: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. Apr 14 18:59:50 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-8baa4a44-be4f-4316-9fc2-20f8ff38f6fe tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Request method failure captured: Apr 14 18:59:50 user devstack@n-api.service[61674]: request: GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be HTTP/1.1 Apr 14 18:59:50 user devstack@n-api.service[61674]: Accept: application/json Apr 14 18:59:50 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 18:59:50 user devstack@n-api.service[61674]: Connection: close Apr 14 18:59:50 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 18:59:50 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 18:59:50 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 18:59:50 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 18:59:50 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 18:59:50 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOZ9tFQYzH-U4RXmRE_GBoSoFEKSavu1XrGPWcT-lLfWHZbvzWQQWjWk59HjQ1Ma0lTR2YMhCPS0AAOW5m4ixuYIAB7rIJDTkb3oWnMUTJ4Uv-ETUGbIaxeHZCMtexw9UCn-fsw1BljHz-gqw0vXC9BSP_BSd7HFV75kPj8WIUaZxMdo Apr 14 18:59:50 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 18:59:50 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 18:59:50 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 18:59:50 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 18:59:50 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 18:59:50 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 18:59:50 user devstack@n-api.service[61674]: X-Project-Id: f028a79640b848228dc6e654a0eef49b Apr 14 18:59:50 user devstack@n-api.service[61674]: X-Project-Name: tempest-ServerActionsTestJSON-2112054326 Apr 14 18:59:50 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 18:59:50 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 18:59:50 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 18:59:50 user devstack@n-api.service[61674]: X-Tenant: tempest-ServerActionsTestJSON-2112054326 Apr 14 18:59:50 user devstack@n-api.service[61674]: X-Tenant-Id: f028a79640b848228dc6e654a0eef49b Apr 14 18:59:50 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-ServerActionsTestJSON-2112054326 Apr 14 18:59:50 user devstack@n-api.service[61674]: X-User: tempest-ServerActionsTestJSON-2112054326-project-member Apr 14 18:59:50 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 18:59:50 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 18:59:50 user devstack@n-api.service[61674]: X-User-Id: 55fa4abe2fdd48cb91f39bf8156a7793 Apr 14 18:59:50 user devstack@n-api.service[61674]: X-User-Name: tempest-ServerActionsTestJSON-2112054326-project-member Apr 14 18:59:50 user devstack@n-api.service[61674]: method: > Apr 14 18:59:50 user devstack@n-api.service[61674]: exception: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. Apr 14 18:59:50 user devstack@n-api.service[61674]: action_args: {'id': 'aa09363f-435d-4fa8-9f11-db0c3f4e08be'} Apr 14 18:59:50 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. Apr 14 18:59:50 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 18:59:50 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-8baa4a44-be4f-4316-9fc2-20f8ff38f6fe tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Returning 404 to user: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 18:59:50 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-8baa4a44-be4f-4316-9fc2-20f8ff38f6fe tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 404 len: 111 microversion: 2.1 time: 0.030572 Apr 14 18:59:50 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 245/722] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:59:50 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 18:59:50 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2011359159", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "networks": [{"uuid": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9"}], "security_groups": [{"name": "tempest-securitygroup--228730137"}], "key_name": "tempest-keypair-1907005832", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:59:51 user devstack@n-api.service[61673]: DEBUG nova.network.neutron [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] validate_networks() for [('cfabb8bd-6f49-4a21-90ab-ee230e7003a9', None, None, None, None, None)] {{(pid=61673) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 18:59:51 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flavor limits 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 18:59:51 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Image limits 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 18:59:51 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flavor pref 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 18:59:51 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Image pref 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 18:59:51 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 18:59:51 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:51 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:51 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:51 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:51 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:51 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:51 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting quotas for project f028a79640b848228dc6e654a0eef49b. Resources: {'ram', 'instances', 'cores'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 18:59:51 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting quotas for user 55fa4abe2fdd48cb91f39bf8156a7793 and project f028a79640b848228dc6e654a0eef49b. Resources: {'ram', 'instances', 'cores'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 18:59:51 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Going to run 1 instances... {{(pid=61673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 18:59:51 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 18:59:51 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.657332 Apr 14 18:59:51 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 239/723] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 18:59:50 2023] POST /compute/v2.1/servers => generated 403 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 18:59:51 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-16b2fada-a2fd-4719-9d9c-95a5c029ccdf tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 18:59:51 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-16b2fada-a2fd-4719-9d9c-95a5c029ccdf tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 18:59:51 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-16b2fada-a2fd-4719-9d9c-95a5c029ccdf tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 18:59:51 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-16b2fada-a2fd-4719-9d9c-95a5c029ccdf tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46d51513-1995-43c5-976a-40789ae575f1" status: 200 len: 1233 microversion: 2.1 time: 0.063326 Apr 14 18:59:51 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 240/724] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 18:59:51 2023] GET /compute/v2.1/servers/46d51513-1995-43c5-976a-40789ae575f1 => generated 1233 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 18:59:54 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-b6a5278d-a89d-4462-9717-7df94ac0be19 req-b26665ab-11c9-4549-a51e-c80bbe8e72a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46d51513-1995-43c5-976a-40789ae575f1", "tag": "48f196d4-dd0c-4499-8b7b-b0c4199cc059"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:59:54 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-b6a5278d-a89d-4462-9717-7df94ac0be19 req-b26665ab-11c9-4549-a51e-c80bbe8e72a5 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:54 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-b6a5278d-a89d-4462-9717-7df94ac0be19 req-b26665ab-11c9-4549-a51e-c80bbe8e72a5 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:54 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-b6a5278d-a89d-4462-9717-7df94ac0be19 req-b26665ab-11c9-4549-a51e-c80bbe8e72a5 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:54 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-b6a5278d-a89d-4462-9717-7df94ac0be19 req-b26665ab-11c9-4549-a51e-c80bbe8e72a5 service nova] Creating event network-changed:48f196d4-dd0c-4499-8b7b-b0c4199cc059 for instance 46d51513-1995-43c5-976a-40789ae575f1 on user Apr 14 18:59:54 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-b6a5278d-a89d-4462-9717-7df94ac0be19 req-b26665ab-11c9-4549-a51e-c80bbe8e72a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037970 Apr 14 18:59:54 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 246/725] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:59:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:59:56 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-246d8317-1fef-4b98-a553-b91b0418e722 req-1baffc63-3861-43d3-9c55-2010373f64ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d51513-1995-43c5-976a-40789ae575f1", "name": "network-vif-plugged", "status": "completed", "tag": "48f196d4-dd0c-4499-8b7b-b0c4199cc059"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:59:56 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-246d8317-1fef-4b98-a553-b91b0418e722 req-1baffc63-3861-43d3-9c55-2010373f64ed service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:56 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-246d8317-1fef-4b98-a553-b91b0418e722 req-1baffc63-3861-43d3-9c55-2010373f64ed service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:56 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-246d8317-1fef-4b98-a553-b91b0418e722 req-1baffc63-3861-43d3-9c55-2010373f64ed service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:56 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-246d8317-1fef-4b98-a553-b91b0418e722 req-1baffc63-3861-43d3-9c55-2010373f64ed service nova] Creating event network-vif-plugged:48f196d4-dd0c-4499-8b7b-b0c4199cc059 for instance 46d51513-1995-43c5-976a-40789ae575f1 on user Apr 14 18:59:56 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-246d8317-1fef-4b98-a553-b91b0418e722 req-1baffc63-3861-43d3-9c55-2010373f64ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034811 Apr 14 18:59:56 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 240/726] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:59:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 18:59:58 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-be77f378-76e0-438f-bec4-f37bb54a80be req-f9c1f2a1-7736-4c4c-818c-a9ce5f2714a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d51513-1995-43c5-976a-40789ae575f1", "name": "network-vif-plugged", "status": "completed", "tag": "48f196d4-dd0c-4499-8b7b-b0c4199cc059"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 18:59:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-be77f378-76e0-438f-bec4-f37bb54a80be req-f9c1f2a1-7736-4c4c-818c-a9ce5f2714a5 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 18:59:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-be77f378-76e0-438f-bec4-f37bb54a80be req-f9c1f2a1-7736-4c4c-818c-a9ce5f2714a5 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 18:59:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-be77f378-76e0-438f-bec4-f37bb54a80be req-f9c1f2a1-7736-4c4c-818c-a9ce5f2714a5 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 18:59:58 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-be77f378-76e0-438f-bec4-f37bb54a80be req-f9c1f2a1-7736-4c4c-818c-a9ce5f2714a5 service nova] Creating event network-vif-plugged:48f196d4-dd0c-4499-8b7b-b0c4199cc059 for instance 46d51513-1995-43c5-976a-40789ae575f1 on user Apr 14 18:59:58 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-be77f378-76e0-438f-bec4-f37bb54a80be req-f9c1f2a1-7736-4c4c-818c-a9ce5f2714a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033900 Apr 14 18:59:58 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 241/727] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 18:59:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:00:00 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-8f4f7687-d2c5-4c8d-83b3-ca90bbedc61c tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:00:00 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-8f4f7687-d2c5-4c8d-83b3-ca90bbedc61c tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:00:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8f4f7687-d2c5-4c8d-83b3-ca90bbedc61c tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8f4f7687-d2c5-4c8d-83b3-ca90bbedc61c tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8f4f7687-d2c5-4c8d-83b3-ca90bbedc61c tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8f4f7687-d2c5-4c8d-83b3-ca90bbedc61c tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8f4f7687-d2c5-4c8d-83b3-ca90bbedc61c tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8f4f7687-d2c5-4c8d-83b3-ca90bbedc61c tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:00 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-8f4f7687-d2c5-4c8d-83b3-ca90bbedc61c tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f90c8f23e3b42a98fdb9261db65f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf25bcc0dea4d3eb1284e8995eb3466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:00:00 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-8f4f7687-d2c5-4c8d-83b3-ca90bbedc61c tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4" status: 200 len: 1656 microversion: 2.1 time: 0.454730 Apr 14 19:00:00 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 247/728] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:00:00 2023] GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4 => generated 1656 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:00:10 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:00:10 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=6 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:00:10 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:00:10 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=6 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:00:10 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-1774cfba-5494-430d-bd70-a238747c5178 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:00:10 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-1774cfba-5494-430d-bd70-a238747c5178 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:00:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1774cfba-5494-430d-bd70-a238747c5178 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1774cfba-5494-430d-bd70-a238747c5178 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1774cfba-5494-430d-bd70-a238747c5178 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1774cfba-5494-430d-bd70-a238747c5178 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1774cfba-5494-430d-bd70-a238747c5178 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1774cfba-5494-430d-bd70-a238747c5178 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:10 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-1774cfba-5494-430d-bd70-a238747c5178 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008a24026e844252b0be1268461bc2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af68184e7654efea3187e05bb10e5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:00:10 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-1774cfba-5494-430d-bd70-a238747c5178 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97aafe40-5587-41cf-ba75-6077d9daa7eb" status: 200 len: 1494 microversion: 2.1 time: 0.240066 Apr 14 19:00:10 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 241/729] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:00:10 2023] GET /compute/v2.1/servers/97aafe40-5587-41cf-ba75-6077d9daa7eb => generated 1494 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:00:16 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:00:16 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=8 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:00:16 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=4 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:00:16 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-3133cbd6-abbe-47ed-ab0d-12139de12ef0 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:00:16 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-3133cbd6-abbe-47ed-ab0d-12139de12ef0 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:00:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3133cbd6-abbe-47ed-ab0d-12139de12ef0 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3133cbd6-abbe-47ed-ab0d-12139de12ef0 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3133cbd6-abbe-47ed-ab0d-12139de12ef0 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3133cbd6-abbe-47ed-ab0d-12139de12ef0 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3133cbd6-abbe-47ed-ab0d-12139de12ef0 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3133cbd6-abbe-47ed-ab0d-12139de12ef0 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:16 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-3133cbd6-abbe-47ed-ab0d-12139de12ef0 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:00:16 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-3133cbd6-abbe-47ed-ab0d-12139de12ef0 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:00:16 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-3133cbd6-abbe-47ed-ab0d-12139de12ef0 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:00:16 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-3133cbd6-abbe-47ed-ab0d-12139de12ef0 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" status: 200 len: 1754 microversion: 2.87 time: 0.264079 Apr 14 19:00:16 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 242/730] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:00:16 2023] GET /compute/v2.1/servers/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 => generated 1754 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 19:00:19 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-dac66f73-082a-4665-a061-aae90ceef78a tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:00:19 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-dac66f73-082a-4665-a061-aae90ceef78a tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:00:19 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=8 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:00:19 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=16 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:00:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-dac66f73-082a-4665-a061-aae90ceef78a tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-dac66f73-082a-4665-a061-aae90ceef78a tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-dac66f73-082a-4665-a061-aae90ceef78a tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-dac66f73-082a-4665-a061-aae90ceef78a tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-dac66f73-082a-4665-a061-aae90ceef78a tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-dac66f73-082a-4665-a061-aae90ceef78a tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:19 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-dac66f73-082a-4665-a061-aae90ceef78a tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] HTTP exception thrown: Instance 68af5668-55ba-4150-be95-b6861afc820d could not be found. Apr 14 19:00:19 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-dac66f73-082a-4665-a061-aae90ceef78a tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Request method failure captured: Apr 14 19:00:19 user devstack@n-api.service[61674]: request: GET /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d HTTP/1.1 Apr 14 19:00:19 user devstack@n-api.service[61674]: Accept: application/json Apr 14 19:00:19 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 19:00:19 user devstack@n-api.service[61674]: Connection: close Apr 14 19:00:19 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 19:00:19 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 19:00:19 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 19:00:19 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 19:00:19 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 19:00:19 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOZ9mXKmSeVaIS46ajndcD0QEVOAAeNy4LVRU6htix22YmE3w_WsO57Wi55e6NRGyVz084DhOrXI8Tp0cfqtkOuptABoiofobC3zYryQ5y6CuXjmj_BNK8q3Ywj-icF3eYh62IR4e0eJMk7NufTqqWbSFQxNccWUoyS1F1P0cbefqlTY Apr 14 19:00:19 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 19:00:19 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 19:00:19 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 19:00:19 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 19:00:19 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 19:00:19 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 19:00:19 user devstack@n-api.service[61674]: X-Project-Id: e34cdebcd7154988a957deae140e8eab Apr 14 19:00:19 user devstack@n-api.service[61674]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:19 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 19:00:19 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 19:00:19 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:00:19 user devstack@n-api.service[61674]: X-Tenant: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:19 user devstack@n-api.service[61674]: X-Tenant-Id: e34cdebcd7154988a957deae140e8eab Apr 14 19:00:19 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:19 user devstack@n-api.service[61674]: X-User: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 19:00:19 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 19:00:19 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 19:00:19 user devstack@n-api.service[61674]: X-User-Id: 8d53edaffb8f4038abd366d7942c6bc7 Apr 14 19:00:19 user devstack@n-api.service[61674]: X-User-Name: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 19:00:19 user devstack@n-api.service[61674]: method: > Apr 14 19:00:19 user devstack@n-api.service[61674]: exception: Instance 68af5668-55ba-4150-be95-b6861afc820d could not be found. Apr 14 19:00:19 user devstack@n-api.service[61674]: action_args: {'id': '68af5668-55ba-4150-be95-b6861afc820d'} Apr 14 19:00:19 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68af5668-55ba-4150-be95-b6861afc820d could not be found. Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68af5668-55ba-4150-be95-b6861afc820d could not be found. Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68af5668-55ba-4150-be95-b6861afc820d could not be found. Apr 14 19:00:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:00:19 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-dac66f73-082a-4665-a061-aae90ceef78a tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Returning 404 to user: Instance 68af5668-55ba-4150-be95-b6861afc820d could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:00:19 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-dac66f73-082a-4665-a061-aae90ceef78a tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d" status: 404 len: 111 microversion: 2.1 time: 0.043759 Apr 14 19:00:19 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 248/731] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:00:19 2023] GET /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:00:19 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-2b242401-1823-4995-9058-2505c18dbf11 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '.version_select at 0x7fdae10a3f40>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:00:19 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-2b242401-1823-4995-9058-2505c18dbf11 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1888884509" status: 202 len: 0 microversion: 2.1 time: 0.024209 Apr 14 19:00:19 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 242/732] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 19:00:19 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1888884509 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 19:00:22 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-300582d5-496a-48ca-97c2-e4fb09553dcc tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:00:22 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-300582d5-496a-48ca-97c2-e4fb09553dcc tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:00:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-300582d5-496a-48ca-97c2-e4fb09553dcc tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-300582d5-496a-48ca-97c2-e4fb09553dcc tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-300582d5-496a-48ca-97c2-e4fb09553dcc tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-300582d5-496a-48ca-97c2-e4fb09553dcc tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-300582d5-496a-48ca-97c2-e4fb09553dcc tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-300582d5-496a-48ca-97c2-e4fb09553dcc tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:22 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-300582d5-496a-48ca-97c2-e4fb09553dcc tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a9414d0c24643fdb162aad828c736bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921435d84194431c886ec1ed1848d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:00:22 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-300582d5-496a-48ca-97c2-e4fb09553dcc tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" status: 200 len: 1537 microversion: 2.1 time: 0.442736 Apr 14 19:00:22 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 243/733] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:00:22 2023] GET /compute/v2.1/servers/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 => generated 1537 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:00:23 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-75d18e33-1f5d-4bd0-be54-05426df904b0 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:00:23 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-75d18e33-1f5d-4bd0-be54-05426df904b0 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:00:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-75d18e33-1f5d-4bd0-be54-05426df904b0 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-75d18e33-1f5d-4bd0-be54-05426df904b0 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-75d18e33-1f5d-4bd0-be54-05426df904b0 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-75d18e33-1f5d-4bd0-be54-05426df904b0 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-75d18e33-1f5d-4bd0-be54-05426df904b0 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-75d18e33-1f5d-4bd0-be54-05426df904b0 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:23 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-75d18e33-1f5d-4bd0-be54-05426df904b0 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] HTTP exception thrown: Instance 68af5668-55ba-4150-be95-b6861afc820d could not be found. Apr 14 19:00:23 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-75d18e33-1f5d-4bd0-be54-05426df904b0 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Request method failure captured: Apr 14 19:00:23 user devstack@n-api.service[61674]: request: DELETE /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d HTTP/1.1 Apr 14 19:00:23 user devstack@n-api.service[61674]: Accept: application/json Apr 14 19:00:23 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 19:00:23 user devstack@n-api.service[61674]: Connection: close Apr 14 19:00:23 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 19:00:23 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 19:00:23 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 19:00:23 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 19:00:23 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 19:00:23 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOZ9mXKmSeVaIS46ajndcD0QEVOAAeNy4LVRU6htix22YmE3w_WsO57Wi55e6NRGyVz084DhOrXI8Tp0cfqtkOuptABoiofobC3zYryQ5y6CuXjmj_BNK8q3Ywj-icF3eYh62IR4e0eJMk7NufTqqWbSFQxNccWUoyS1F1P0cbefqlTY Apr 14 19:00:23 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 19:00:23 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 19:00:23 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 19:00:23 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 19:00:23 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 19:00:23 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 19:00:23 user devstack@n-api.service[61674]: X-Project-Id: e34cdebcd7154988a957deae140e8eab Apr 14 19:00:23 user devstack@n-api.service[61674]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:23 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 19:00:23 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 19:00:23 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:00:23 user devstack@n-api.service[61674]: X-Tenant: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:23 user devstack@n-api.service[61674]: X-Tenant-Id: e34cdebcd7154988a957deae140e8eab Apr 14 19:00:23 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:23 user devstack@n-api.service[61674]: X-User: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 19:00:23 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 19:00:23 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 19:00:23 user devstack@n-api.service[61674]: X-User-Id: 8d53edaffb8f4038abd366d7942c6bc7 Apr 14 19:00:23 user devstack@n-api.service[61674]: X-User-Name: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 19:00:23 user devstack@n-api.service[61674]: method: > Apr 14 19:00:23 user devstack@n-api.service[61674]: exception: Instance 68af5668-55ba-4150-be95-b6861afc820d could not be found. Apr 14 19:00:23 user devstack@n-api.service[61674]: action_args: {'id': '68af5668-55ba-4150-be95-b6861afc820d'} Apr 14 19:00:23 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68af5668-55ba-4150-be95-b6861afc820d could not be found. Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68af5668-55ba-4150-be95-b6861afc820d could not be found. Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68af5668-55ba-4150-be95-b6861afc820d could not be found. Apr 14 19:00:23 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:00:23 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-75d18e33-1f5d-4bd0-be54-05426df904b0 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Returning 404 to user: Instance 68af5668-55ba-4150-be95-b6861afc820d could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:00:23 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-75d18e33-1f5d-4bd0-be54-05426df904b0 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d" status: 404 len: 111 microversion: 2.1 time: 0.031404 Apr 14 19:00:23 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 249/734] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:00:23 2023] DELETE /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:00:23 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=6 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:00:23 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-f3b17058-1132-4d15-9f79-0c94b6c08433 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:00:23 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-f3b17058-1132-4d15-9f79-0c94b6c08433 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:00:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f3b17058-1132-4d15-9f79-0c94b6c08433 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f3b17058-1132-4d15-9f79-0c94b6c08433 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f3b17058-1132-4d15-9f79-0c94b6c08433 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f3b17058-1132-4d15-9f79-0c94b6c08433 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f3b17058-1132-4d15-9f79-0c94b6c08433 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f3b17058-1132-4d15-9f79-0c94b6c08433 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:23 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-f3b17058-1132-4d15-9f79-0c94b6c08433 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] HTTP exception thrown: Instance 68af5668-55ba-4150-be95-b6861afc820d could not be found. Apr 14 19:00:23 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-f3b17058-1132-4d15-9f79-0c94b6c08433 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Request method failure captured: Apr 14 19:00:23 user devstack@n-api.service[61673]: request: GET /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d HTTP/1.1 Apr 14 19:00:23 user devstack@n-api.service[61673]: Accept: application/json Apr 14 19:00:23 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 19:00:23 user devstack@n-api.service[61673]: Connection: close Apr 14 19:00:23 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 19:00:23 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 19:00:23 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 19:00:23 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 19:00:23 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 19:00:23 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOZ9mXKmSeVaIS46ajndcD0QEVOAAeNy4LVRU6htix22YmE3w_WsO57Wi55e6NRGyVz084DhOrXI8Tp0cfqtkOuptABoiofobC3zYryQ5y6CuXjmj_BNK8q3Ywj-icF3eYh62IR4e0eJMk7NufTqqWbSFQxNccWUoyS1F1P0cbefqlTY Apr 14 19:00:23 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 19:00:23 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 19:00:23 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 19:00:23 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 19:00:23 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 19:00:23 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 19:00:23 user devstack@n-api.service[61673]: X-Project-Id: e34cdebcd7154988a957deae140e8eab Apr 14 19:00:23 user devstack@n-api.service[61673]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:23 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 19:00:23 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 19:00:23 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:00:23 user devstack@n-api.service[61673]: X-Tenant: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:23 user devstack@n-api.service[61673]: X-Tenant-Id: e34cdebcd7154988a957deae140e8eab Apr 14 19:00:23 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:23 user devstack@n-api.service[61673]: X-User: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 19:00:23 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 19:00:23 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 19:00:23 user devstack@n-api.service[61673]: X-User-Id: 8d53edaffb8f4038abd366d7942c6bc7 Apr 14 19:00:23 user devstack@n-api.service[61673]: X-User-Name: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 19:00:23 user devstack@n-api.service[61673]: method: > Apr 14 19:00:23 user devstack@n-api.service[61673]: exception: Instance 68af5668-55ba-4150-be95-b6861afc820d could not be found. Apr 14 19:00:23 user devstack@n-api.service[61673]: action_args: {'id': '68af5668-55ba-4150-be95-b6861afc820d'} Apr 14 19:00:23 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68af5668-55ba-4150-be95-b6861afc820d could not be found. Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68af5668-55ba-4150-be95-b6861afc820d could not be found. Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68af5668-55ba-4150-be95-b6861afc820d could not be found. Apr 14 19:00:23 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:00:23 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-f3b17058-1132-4d15-9f79-0c94b6c08433 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Returning 404 to user: Instance 68af5668-55ba-4150-be95-b6861afc820d could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:00:23 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-f3b17058-1132-4d15-9f79-0c94b6c08433 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d" status: 404 len: 111 microversion: 2.1 time: 0.030486 Apr 14 19:00:23 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 243/735] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:00:23 2023] GET /compute/v2.1/servers/68af5668-55ba-4150-be95-b6861afc820d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:00:24 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-6e90cd87-bc4e-4bdb-9701-eab78fdb7d42 req-32a7d113-35ff-41bf-9320-3c7e106a5e68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58", "tag": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:00:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-6e90cd87-bc4e-4bdb-9701-eab78fdb7d42 req-32a7d113-35ff-41bf-9320-3c7e106a5e68 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-6e90cd87-bc4e-4bdb-9701-eab78fdb7d42 req-32a7d113-35ff-41bf-9320-3c7e106a5e68 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-6e90cd87-bc4e-4bdb-9701-eab78fdb7d42 req-32a7d113-35ff-41bf-9320-3c7e106a5e68 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:24 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-6e90cd87-bc4e-4bdb-9701-eab78fdb7d42 req-32a7d113-35ff-41bf-9320-3c7e106a5e68 service nova] Creating event network-changed:9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 for instance 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 on user Apr 14 19:00:24 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-6e90cd87-bc4e-4bdb-9701-eab78fdb7d42 req-32a7d113-35ff-41bf-9320-3c7e106a5e68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038079 Apr 14 19:00:24 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 244/736] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:00:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:00:24 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05d753af-2264-480f-922d-67abff014dfd"}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:00:24 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:00:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:25 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 10.0.0.210 "POST /compute/v2.1/servers/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311833 Apr 14 19:00:25 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 250/737] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 19:00:24 2023] POST /compute/v2.1/servers/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:00:26 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-d1c262e0-28d1-4ae5-bcc2-58e82683bf6d tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:00:26 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-d1c262e0-28d1-4ae5-bcc2-58e82683bf6d tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:00:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d1c262e0-28d1-4ae5-bcc2-58e82683bf6d tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d1c262e0-28d1-4ae5-bcc2-58e82683bf6d tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d1c262e0-28d1-4ae5-bcc2-58e82683bf6d tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d1c262e0-28d1-4ae5-bcc2-58e82683bf6d tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d1c262e0-28d1-4ae5-bcc2-58e82683bf6d tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d1c262e0-28d1-4ae5-bcc2-58e82683bf6d tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:26 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-d1c262e0-28d1-4ae5-bcc2-58e82683bf6d tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] HTTP exception thrown: Instance 61944d61-738b-42a7-a95d-8caa6fa29a38 could not be found. Apr 14 19:00:26 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-d1c262e0-28d1-4ae5-bcc2-58e82683bf6d tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Request method failure captured: Apr 14 19:00:26 user devstack@n-api.service[61673]: request: DELETE /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38 HTTP/1.1 Apr 14 19:00:26 user devstack@n-api.service[61673]: Accept: application/json Apr 14 19:00:26 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 19:00:26 user devstack@n-api.service[61673]: Connection: close Apr 14 19:00:26 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 19:00:26 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 19:00:26 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 19:00:26 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 19:00:26 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOZ9mXKmSeVaIS46ajndcD0QEVOAAeNy4LVRU6htix22YmE3w_WsO57Wi55e6NRGyVz084DhOrXI8Tp0cfqtkOuptABoiofobC3zYryQ5y6CuXjmj_BNK8q3Ywj-icF3eYh62IR4e0eJMk7NufTqqWbSFQxNccWUoyS1F1P0cbefqlTY Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Project-Id: e34cdebcd7154988a957deae140e8eab Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Tenant: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Tenant-Id: e34cdebcd7154988a957deae140e8eab Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:26 user devstack@n-api.service[61673]: X-User: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 19:00:26 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 19:00:26 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 19:00:26 user devstack@n-api.service[61673]: X-User-Id: 8d53edaffb8f4038abd366d7942c6bc7 Apr 14 19:00:26 user devstack@n-api.service[61673]: X-User-Name: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 19:00:26 user devstack@n-api.service[61673]: method: > Apr 14 19:00:26 user devstack@n-api.service[61673]: exception: Instance 61944d61-738b-42a7-a95d-8caa6fa29a38 could not be found. Apr 14 19:00:26 user devstack@n-api.service[61673]: action_args: {'id': '61944d61-738b-42a7-a95d-8caa6fa29a38'} Apr 14 19:00:26 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61944d61-738b-42a7-a95d-8caa6fa29a38 could not be found. Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61944d61-738b-42a7-a95d-8caa6fa29a38 could not be found. Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61944d61-738b-42a7-a95d-8caa6fa29a38 could not be found. Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:00:26 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-d1c262e0-28d1-4ae5-bcc2-58e82683bf6d tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Returning 404 to user: Instance 61944d61-738b-42a7-a95d-8caa6fa29a38 could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:00:26 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-d1c262e0-28d1-4ae5-bcc2-58e82683bf6d tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38" status: 404 len: 111 microversion: 2.1 time: 0.049118 Apr 14 19:00:26 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 244/738] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:00:26 2023] DELETE /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:00:26 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-e81e9877-e516-4c28-be11-c667c3021eec tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:00:26 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-e81e9877-e516-4c28-be11-c667c3021eec tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:00:26 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e81e9877-e516-4c28-be11-c667c3021eec tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:26 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e81e9877-e516-4c28-be11-c667c3021eec tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:26 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e81e9877-e516-4c28-be11-c667c3021eec tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:26 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e81e9877-e516-4c28-be11-c667c3021eec tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:26 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e81e9877-e516-4c28-be11-c667c3021eec tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:26 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e81e9877-e516-4c28-be11-c667c3021eec tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:26 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-e81e9877-e516-4c28-be11-c667c3021eec tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] HTTP exception thrown: Instance 61944d61-738b-42a7-a95d-8caa6fa29a38 could not be found. Apr 14 19:00:26 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-e81e9877-e516-4c28-be11-c667c3021eec tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Request method failure captured: Apr 14 19:00:26 user devstack@n-api.service[61675]: request: GET /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38 HTTP/1.1 Apr 14 19:00:26 user devstack@n-api.service[61675]: Accept: application/json Apr 14 19:00:26 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 19:00:26 user devstack@n-api.service[61675]: Connection: close Apr 14 19:00:26 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 19:00:26 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 19:00:26 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 19:00:26 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 19:00:26 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 19:00:26 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOZ9mXKmSeVaIS46ajndcD0QEVOAAeNy4LVRU6htix22YmE3w_WsO57Wi55e6NRGyVz084DhOrXI8Tp0cfqtkOuptABoiofobC3zYryQ5y6CuXjmj_BNK8q3Ywj-icF3eYh62IR4e0eJMk7NufTqqWbSFQxNccWUoyS1F1P0cbefqlTY Apr 14 19:00:26 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 19:00:26 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 19:00:26 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 19:00:26 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 19:00:26 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 19:00:26 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 19:00:26 user devstack@n-api.service[61675]: X-Project-Id: e34cdebcd7154988a957deae140e8eab Apr 14 19:00:26 user devstack@n-api.service[61675]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:26 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 19:00:26 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 19:00:26 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:00:26 user devstack@n-api.service[61675]: X-Tenant: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:26 user devstack@n-api.service[61675]: X-Tenant-Id: e34cdebcd7154988a957deae140e8eab Apr 14 19:00:26 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:26 user devstack@n-api.service[61675]: X-User: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 19:00:26 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 19:00:26 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 19:00:26 user devstack@n-api.service[61675]: X-User-Id: 8d53edaffb8f4038abd366d7942c6bc7 Apr 14 19:00:26 user devstack@n-api.service[61675]: X-User-Name: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 19:00:26 user devstack@n-api.service[61675]: method: > Apr 14 19:00:26 user devstack@n-api.service[61675]: exception: Instance 61944d61-738b-42a7-a95d-8caa6fa29a38 could not be found. Apr 14 19:00:26 user devstack@n-api.service[61675]: action_args: {'id': '61944d61-738b-42a7-a95d-8caa6fa29a38'} Apr 14 19:00:26 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61944d61-738b-42a7-a95d-8caa6fa29a38 could not be found. Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61944d61-738b-42a7-a95d-8caa6fa29a38 could not be found. Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61944d61-738b-42a7-a95d-8caa6fa29a38 could not be found. Apr 14 19:00:26 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:00:26 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-e81e9877-e516-4c28-be11-c667c3021eec tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Returning 404 to user: Instance 61944d61-738b-42a7-a95d-8caa6fa29a38 could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:00:26 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-e81e9877-e516-4c28-be11-c667c3021eec tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38" status: 404 len: 111 microversion: 2.1 time: 0.032531 Apr 14 19:00:26 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 245/739] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:00:26 2023] GET /compute/v2.1/servers/61944d61-738b-42a7-a95d-8caa6fa29a38 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:00:26 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-a3cecee7-6920-4955-8d14-7105e81c85a8 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:00:26 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-a3cecee7-6920-4955-8d14-7105e81c85a8 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:00:26 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-a3cecee7-6920-4955-8d14-7105e81c85a8 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:26 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-a3cecee7-6920-4955-8d14-7105e81c85a8 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:26 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-a3cecee7-6920-4955-8d14-7105e81c85a8 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:26 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-a3cecee7-6920-4955-8d14-7105e81c85a8 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:26 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-a3cecee7-6920-4955-8d14-7105e81c85a8 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:26 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-a3cecee7-6920-4955-8d14-7105e81c85a8 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:26 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-a3cecee7-6920-4955-8d14-7105e81c85a8 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] HTTP exception thrown: Instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 could not be found. Apr 14 19:00:26 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-a3cecee7-6920-4955-8d14-7105e81c85a8 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Request method failure captured: Apr 14 19:00:26 user devstack@n-api.service[61674]: request: DELETE /compute/v2.1/servers/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 HTTP/1.1 Apr 14 19:00:26 user devstack@n-api.service[61674]: Accept: application/json Apr 14 19:00:26 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 19:00:26 user devstack@n-api.service[61674]: Connection: close Apr 14 19:00:26 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 19:00:26 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 19:00:26 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 19:00:26 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 19:00:26 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 19:00:26 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOZ9mXKmSeVaIS46ajndcD0QEVOAAeNy4LVRU6htix22YmE3w_WsO57Wi55e6NRGyVz084DhOrXI8Tp0cfqtkOuptABoiofobC3zYryQ5y6CuXjmj_BNK8q3Ywj-icF3eYh62IR4e0eJMk7NufTqqWbSFQxNccWUoyS1F1P0cbefqlTY Apr 14 19:00:26 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 19:00:26 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 19:00:26 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 19:00:26 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 19:00:26 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 19:00:26 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 19:00:26 user devstack@n-api.service[61674]: X-Project-Id: e34cdebcd7154988a957deae140e8eab Apr 14 19:00:26 user devstack@n-api.service[61674]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:26 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 19:00:26 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 19:00:26 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:00:26 user devstack@n-api.service[61674]: X-Tenant: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:26 user devstack@n-api.service[61674]: X-Tenant-Id: e34cdebcd7154988a957deae140e8eab Apr 14 19:00:26 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:26 user devstack@n-api.service[61674]: X-User: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 19:00:26 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 19:00:26 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 19:00:26 user devstack@n-api.service[61674]: X-User-Id: 8d53edaffb8f4038abd366d7942c6bc7 Apr 14 19:00:26 user devstack@n-api.service[61674]: X-User-Name: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 19:00:26 user devstack@n-api.service[61674]: method: > Apr 14 19:00:26 user devstack@n-api.service[61674]: exception: Instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 could not be found. Apr 14 19:00:26 user devstack@n-api.service[61674]: action_args: {'id': 'a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9'} Apr 14 19:00:26 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 could not be found. Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 could not be found. Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 could not be found. Apr 14 19:00:26 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:00:26 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-a3cecee7-6920-4955-8d14-7105e81c85a8 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Returning 404 to user: Instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:00:26 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-a3cecee7-6920-4955-8d14-7105e81c85a8 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9" status: 404 len: 111 microversion: 2.1 time: 0.031716 Apr 14 19:00:26 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 251/740] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:00:26 2023] DELETE /compute/v2.1/servers/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:00:26 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-4752ede2-9469-42d4-95c5-682db734c8d2 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:00:26 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-4752ede2-9469-42d4-95c5-682db734c8d2 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:00:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4752ede2-9469-42d4-95c5-682db734c8d2 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4752ede2-9469-42d4-95c5-682db734c8d2 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4752ede2-9469-42d4-95c5-682db734c8d2 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4752ede2-9469-42d4-95c5-682db734c8d2 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4752ede2-9469-42d4-95c5-682db734c8d2 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4752ede2-9469-42d4-95c5-682db734c8d2 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:26 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-4752ede2-9469-42d4-95c5-682db734c8d2 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] HTTP exception thrown: Instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 could not be found. Apr 14 19:00:26 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-4752ede2-9469-42d4-95c5-682db734c8d2 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Request method failure captured: Apr 14 19:00:26 user devstack@n-api.service[61673]: request: GET /compute/v2.1/servers/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 HTTP/1.1 Apr 14 19:00:26 user devstack@n-api.service[61673]: Accept: application/json Apr 14 19:00:26 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 19:00:26 user devstack@n-api.service[61673]: Connection: close Apr 14 19:00:26 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 19:00:26 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 19:00:26 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 19:00:26 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 19:00:26 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOZ9mXKmSeVaIS46ajndcD0QEVOAAeNy4LVRU6htix22YmE3w_WsO57Wi55e6NRGyVz084DhOrXI8Tp0cfqtkOuptABoiofobC3zYryQ5y6CuXjmj_BNK8q3Ywj-icF3eYh62IR4e0eJMk7NufTqqWbSFQxNccWUoyS1F1P0cbefqlTY Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Project-Id: e34cdebcd7154988a957deae140e8eab Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Tenant: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Tenant-Id: e34cdebcd7154988a957deae140e8eab Apr 14 19:00:26 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:26 user devstack@n-api.service[61673]: X-User: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 19:00:26 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 19:00:26 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 19:00:26 user devstack@n-api.service[61673]: X-User-Id: 8d53edaffb8f4038abd366d7942c6bc7 Apr 14 19:00:26 user devstack@n-api.service[61673]: X-User-Name: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 19:00:26 user devstack@n-api.service[61673]: method: > Apr 14 19:00:26 user devstack@n-api.service[61673]: exception: Instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 could not be found. Apr 14 19:00:26 user devstack@n-api.service[61673]: action_args: {'id': 'a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9'} Apr 14 19:00:26 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 could not be found. Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 could not be found. Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 could not be found. Apr 14 19:00:26 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:00:26 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-4752ede2-9469-42d4-95c5-682db734c8d2 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Returning 404 to user: Instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:00:26 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-4752ede2-9469-42d4-95c5-682db734c8d2 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9" status: 404 len: 111 microversion: 2.1 time: 0.027591 Apr 14 19:00:26 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 245/741] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:00:26 2023] GET /compute/v2.1/servers/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:00:30 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-10d1f1d6-bae3-4b7f-9e1f-f1b7a8061242 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:00:30 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-10d1f1d6-bae3-4b7f-9e1f-f1b7a8061242 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:00:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-10d1f1d6-bae3-4b7f-9e1f-f1b7a8061242 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-10d1f1d6-bae3-4b7f-9e1f-f1b7a8061242 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-10d1f1d6-bae3-4b7f-9e1f-f1b7a8061242 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-10d1f1d6-bae3-4b7f-9e1f-f1b7a8061242 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-10d1f1d6-bae3-4b7f-9e1f-f1b7a8061242 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-10d1f1d6-bae3-4b7f-9e1f-f1b7a8061242 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:31 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-10d1f1d6-bae3-4b7f-9e1f-f1b7a8061242 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] HTTP exception thrown: Instance 094a4a33-569e-4137-8798-743499f1046c could not be found. Apr 14 19:00:31 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-10d1f1d6-bae3-4b7f-9e1f-f1b7a8061242 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Request method failure captured: Apr 14 19:00:31 user devstack@n-api.service[61675]: request: DELETE /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c HTTP/1.1 Apr 14 19:00:31 user devstack@n-api.service[61675]: Accept: application/json Apr 14 19:00:31 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 19:00:31 user devstack@n-api.service[61675]: Connection: close Apr 14 19:00:31 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 19:00:31 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 19:00:31 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 19:00:31 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 19:00:31 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 19:00:31 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOZ9mXKmSeVaIS46ajndcD0QEVOAAeNy4LVRU6htix22YmE3w_WsO57Wi55e6NRGyVz084DhOrXI8Tp0cfqtkOuptABoiofobC3zYryQ5y6CuXjmj_BNK8q3Ywj-icF3eYh62IR4e0eJMk7NufTqqWbSFQxNccWUoyS1F1P0cbefqlTY Apr 14 19:00:31 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 19:00:31 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 19:00:31 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 19:00:31 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 19:00:31 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 19:00:31 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 19:00:31 user devstack@n-api.service[61675]: X-Project-Id: e34cdebcd7154988a957deae140e8eab Apr 14 19:00:31 user devstack@n-api.service[61675]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:31 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 19:00:31 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 19:00:31 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:00:31 user devstack@n-api.service[61675]: X-Tenant: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:31 user devstack@n-api.service[61675]: X-Tenant-Id: e34cdebcd7154988a957deae140e8eab Apr 14 19:00:31 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:31 user devstack@n-api.service[61675]: X-User: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 19:00:31 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 19:00:31 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 19:00:31 user devstack@n-api.service[61675]: X-User-Id: 8d53edaffb8f4038abd366d7942c6bc7 Apr 14 19:00:31 user devstack@n-api.service[61675]: X-User-Name: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 19:00:31 user devstack@n-api.service[61675]: method: > Apr 14 19:00:31 user devstack@n-api.service[61675]: exception: Instance 094a4a33-569e-4137-8798-743499f1046c could not be found. Apr 14 19:00:31 user devstack@n-api.service[61675]: action_args: {'id': '094a4a33-569e-4137-8798-743499f1046c'} Apr 14 19:00:31 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 094a4a33-569e-4137-8798-743499f1046c could not be found. Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 094a4a33-569e-4137-8798-743499f1046c could not be found. Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 094a4a33-569e-4137-8798-743499f1046c could not be found. Apr 14 19:00:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:00:31 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-10d1f1d6-bae3-4b7f-9e1f-f1b7a8061242 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Returning 404 to user: Instance 094a4a33-569e-4137-8798-743499f1046c could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:00:31 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-10d1f1d6-bae3-4b7f-9e1f-f1b7a8061242 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c" status: 404 len: 111 microversion: 2.1 time: 0.101451 Apr 14 19:00:31 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 246/742] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:00:30 2023] DELETE /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:00:31 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-e9f0ce45-c860-4a74-a419-f86e65ba18d9 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:00:31 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-e9f0ce45-c860-4a74-a419-f86e65ba18d9 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:00:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e9f0ce45-c860-4a74-a419-f86e65ba18d9 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e9f0ce45-c860-4a74-a419-f86e65ba18d9 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e9f0ce45-c860-4a74-a419-f86e65ba18d9 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e9f0ce45-c860-4a74-a419-f86e65ba18d9 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e9f0ce45-c860-4a74-a419-f86e65ba18d9 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e9f0ce45-c860-4a74-a419-f86e65ba18d9 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:31 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-e9f0ce45-c860-4a74-a419-f86e65ba18d9 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] HTTP exception thrown: Instance 094a4a33-569e-4137-8798-743499f1046c could not be found. Apr 14 19:00:31 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-e9f0ce45-c860-4a74-a419-f86e65ba18d9 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Request method failure captured: Apr 14 19:00:31 user devstack@n-api.service[61674]: request: GET /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c HTTP/1.1 Apr 14 19:00:31 user devstack@n-api.service[61674]: Accept: application/json Apr 14 19:00:31 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 19:00:31 user devstack@n-api.service[61674]: Connection: close Apr 14 19:00:31 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 19:00:31 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 19:00:31 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 19:00:31 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 19:00:31 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 19:00:31 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOZ9mXKmSeVaIS46ajndcD0QEVOAAeNy4LVRU6htix22YmE3w_WsO57Wi55e6NRGyVz084DhOrXI8Tp0cfqtkOuptABoiofobC3zYryQ5y6CuXjmj_BNK8q3Ywj-icF3eYh62IR4e0eJMk7NufTqqWbSFQxNccWUoyS1F1P0cbefqlTY Apr 14 19:00:31 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 19:00:31 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 19:00:31 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 19:00:31 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 19:00:31 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 19:00:31 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 19:00:31 user devstack@n-api.service[61674]: X-Project-Id: e34cdebcd7154988a957deae140e8eab Apr 14 19:00:31 user devstack@n-api.service[61674]: X-Project-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:31 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 19:00:31 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 19:00:31 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e34cdebcd7154988a957deae140e8eab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:00:31 user devstack@n-api.service[61674]: X-Tenant: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:31 user devstack@n-api.service[61674]: X-Tenant-Id: e34cdebcd7154988a957deae140e8eab Apr 14 19:00:31 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1648028886 Apr 14 19:00:31 user devstack@n-api.service[61674]: X-User: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 19:00:31 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 19:00:31 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 19:00:31 user devstack@n-api.service[61674]: X-User-Id: 8d53edaffb8f4038abd366d7942c6bc7 Apr 14 19:00:31 user devstack@n-api.service[61674]: X-User-Name: tempest-AttachVolumeNegativeTest-1648028886-project-member Apr 14 19:00:31 user devstack@n-api.service[61674]: method: > Apr 14 19:00:31 user devstack@n-api.service[61674]: exception: Instance 094a4a33-569e-4137-8798-743499f1046c could not be found. Apr 14 19:00:31 user devstack@n-api.service[61674]: action_args: {'id': '094a4a33-569e-4137-8798-743499f1046c'} Apr 14 19:00:31 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 094a4a33-569e-4137-8798-743499f1046c could not be found. Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 094a4a33-569e-4137-8798-743499f1046c could not be found. Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 094a4a33-569e-4137-8798-743499f1046c could not be found. Apr 14 19:00:31 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:00:31 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-e9f0ce45-c860-4a74-a419-f86e65ba18d9 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Returning 404 to user: Instance 094a4a33-569e-4137-8798-743499f1046c could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:00:31 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-e9f0ce45-c860-4a74-a419-f86e65ba18d9 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 10.0.0.210 "GET /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c" status: 404 len: 111 microversion: 2.1 time: 0.029077 Apr 14 19:00:31 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 252/743] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:00:31 2023] GET /compute/v2.1/servers/094a4a33-569e-4137-8798-743499f1046c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:00:32 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:00:32 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:00:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:33 user devstack@n-api.service[61673]: DEBUG nova.objects.instance [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lazy-loading 'services' on Instance uuid 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 {{(pid=61673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 19:00:33 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/os-volume_attachments/05d753af-2264-480f-922d-67abff014dfd" status: 202 len: 0 microversion: 2.1 time: 0.174022 Apr 14 19:00:33 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 246/744] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 19:00:32 2023] DELETE /compute/v2.1/servers/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/os-volume_attachments/05d753af-2264-480f-922d-67abff014dfd => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 19:00:33 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-00bf3508-b727-4181-80c4-60d2a5f977c3 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:00:33 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-00bf3508-b727-4181-80c4-60d2a5f977c3 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:00:33 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-00bf3508-b727-4181-80c4-60d2a5f977c3 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:33 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-00bf3508-b727-4181-80c4-60d2a5f977c3 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:33 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-00bf3508-b727-4181-80c4-60d2a5f977c3 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:33 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-00bf3508-b727-4181-80c4-60d2a5f977c3 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:33 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-00bf3508-b727-4181-80c4-60d2a5f977c3 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:33 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-00bf3508-b727-4181-80c4-60d2a5f977c3 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:33 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-00bf3508-b727-4181-80c4-60d2a5f977c3 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066767 Apr 14 19:00:33 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 247/745] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 19:00:33 2023] GET /compute/v2.1/servers/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:00:38 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-7f1386ec-c013-4bbd-a97d-a3b1b5261077 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:00:38 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-7f1386ec-c013-4bbd-a97d-a3b1b5261077 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:00:38 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7f1386ec-c013-4bbd-a97d-a3b1b5261077 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:38 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7f1386ec-c013-4bbd-a97d-a3b1b5261077 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:38 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7f1386ec-c013-4bbd-a97d-a3b1b5261077 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:38 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7f1386ec-c013-4bbd-a97d-a3b1b5261077 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:38 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7f1386ec-c013-4bbd-a97d-a3b1b5261077 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:38 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7f1386ec-c013-4bbd-a97d-a3b1b5261077 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:38 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-7f1386ec-c013-4bbd-a97d-a3b1b5261077 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:00:38 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-7f1386ec-c013-4bbd-a97d-a3b1b5261077 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56097076-1e63-41ba-8331-be8ede06c537" status: 200 len: 1391 microversion: 2.1 time: 0.428272 Apr 14 19:00:38 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 253/746] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:00:38 2023] GET /compute/v2.1/servers/56097076-1e63-41ba-8331-be8ede06c537 => generated 1391 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:00:38 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-00134161-4ed7-43ab-a3e6-c778c5255e8b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1296217083"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:00:38 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-00134161-4ed7-43ab-a3e6-c778c5255e8b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:00:38 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-00134161-4ed7-43ab-a3e6-c778c5255e8b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:38 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-00134161-4ed7-43ab-a3e6-c778c5255e8b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:38 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-00134161-4ed7-43ab-a3e6-c778c5255e8b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:38 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-00134161-4ed7-43ab-a3e6-c778c5255e8b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:38 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-00134161-4ed7-43ab-a3e6-c778c5255e8b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:38 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-00134161-4ed7-43ab-a3e6-c778c5255e8b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:38 user devstack@n-api.service[61673]: INFO nova.compute.api [None req-00134161-4ed7-43ab-a3e6-c778c5255e8b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Attempting to quiesce instance before volume snapshot. Apr 14 19:00:38 user devstack@n-api.service[61673]: INFO nova.compute.api [None req-00134161-4ed7-43ab-a3e6-c778c5255e8b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 14 19:00:39 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-00134161-4ed7-43ab-a3e6-c778c5255e8b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Creating snapshot from volume 84ea013c-1c59-46c4-b9be-9feb9dd5409d. {{(pid=61673) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 14 19:00:41 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-00134161-4ed7-43ab-a3e6-c778c5255e8b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "POST /compute/v2.1/servers/56097076-1e63-41ba-8331-be8ede06c537/action" status: 202 len: 0 microversion: 2.1 time: 2.595209 Apr 14 19:00:41 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 247/747] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 19:00:38 2023] POST /compute/v2.1/servers/56097076-1e63-41ba-8331-be8ede06c537/action => generated 0 bytes in 2597 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 19:00:41 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-64d59420-556a-43f2-b330-986ab2b21741 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:00:41 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-64d59420-556a-43f2-b330-986ab2b21741 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:00:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-64d59420-556a-43f2-b330-986ab2b21741 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-64d59420-556a-43f2-b330-986ab2b21741 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-64d59420-556a-43f2-b330-986ab2b21741 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-64d59420-556a-43f2-b330-986ab2b21741 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-64d59420-556a-43f2-b330-986ab2b21741 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-64d59420-556a-43f2-b330-986ab2b21741 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:41 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-64d59420-556a-43f2-b330-986ab2b21741 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:00:41 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-64d59420-556a-43f2-b330-986ab2b21741 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46d51513-1995-43c5-976a-40789ae575f1" status: 200 len: 1539 microversion: 2.1 time: 0.268713 Apr 14 19:00:41 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 248/748] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:00:41 2023] GET /compute/v2.1/servers/46d51513-1995-43c5-976a-40789ae575f1 => generated 1539 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:00:42 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-263545530", "imageRef": "ff35c27c-c625-4fb5-b0ea-54a8464c1258", "flavorRef": "42", "networks": [{"uuid": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70"}]}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:00:42 user devstack@n-api.service[61674]: DEBUG nova.network.neutron [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] validate_networks() for [('bfa4fdbb-10b3-4715-9ff2-b717d052cc70', None, None, None, None, None)] {{(pid=61674) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 19:00:43 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flavor limits 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 19:00:43 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Image limits 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 19:00:43 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flavor pref 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 19:00:43 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Image pref 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 19:00:43 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 19:00:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:43 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Getting quotas for project 72d2bf68325a4a18934a8403571c24bb. Resources: {'ram', 'instances', 'cores'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 19:00:43 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Getting quotas for user fc3bed70703a49c8bdec2f50193c7f70 and project 72d2bf68325a4a18934a8403571c24bb. Resources: {'ram', 'instances', 'cores'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 19:00:43 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Going to run 1 instances... {{(pid=61674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 19:00:43 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='01b3cb6e-8440-4e21-a3f8-3099c6f0e545',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 19:00:43 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.880445 Apr 14 19:00:43 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 254/749] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 19:00:42 2023] POST /compute/v2.1/servers => generated 378 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 19:00:43 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-a1f80e14-6a74-4c14-8953-f0242dfa3550 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:00:43 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-a1f80e14-6a74-4c14-8953-f0242dfa3550 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:00:43 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:00:44 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-a1f80e14-6a74-4c14-8953-f0242dfa3550 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:00:44 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-a1f80e14-6a74-4c14-8953-f0242dfa3550 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/698bc2dc-aff4-4148-b80e-8b77c846faf7" status: 200 len: 1223 microversion: 2.1 time: 0.408504 Apr 14 19:00:44 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 248/750] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:00:43 2023] GET /compute/v2.1/servers/698bc2dc-aff4-4148-b80e-8b77c846faf7 => generated 1223 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:00:46 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-5f2c8813-4e0d-4d75-9beb-b0590c6bc45f req-79906ad2-e62d-4ce0-b332-6b818c6f626a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "698bc2dc-aff4-4148-b80e-8b77c846faf7", "tag": "dc45a89d-f20f-49e4-a526-0355bb98b37f"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:00:46 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=17 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:00:46 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-5f2c8813-4e0d-4d75-9beb-b0590c6bc45f req-79906ad2-e62d-4ce0-b332-6b818c6f626a service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:46 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-5f2c8813-4e0d-4d75-9beb-b0590c6bc45f req-79906ad2-e62d-4ce0-b332-6b818c6f626a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:46 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-5f2c8813-4e0d-4d75-9beb-b0590c6bc45f req-79906ad2-e62d-4ce0-b332-6b818c6f626a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:46 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=31 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:00:46 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-5f2c8813-4e0d-4d75-9beb-b0590c6bc45f req-79906ad2-e62d-4ce0-b332-6b818c6f626a service nova] Creating event network-changed:dc45a89d-f20f-49e4-a526-0355bb98b37f for instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 on user Apr 14 19:00:46 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-5f2c8813-4e0d-4d75-9beb-b0590c6bc45f req-79906ad2-e62d-4ce0-b332-6b818c6f626a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049257 Apr 14 19:00:46 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 249/751] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:00:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:00:48 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-7908bc36-957f-4966-9098-24bfb729f945 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:00:48 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-7908bc36-957f-4966-9098-24bfb729f945 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:00:48 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7908bc36-957f-4966-9098-24bfb729f945 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:48 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7908bc36-957f-4966-9098-24bfb729f945 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:48 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7908bc36-957f-4966-9098-24bfb729f945 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:48 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7908bc36-957f-4966-9098-24bfb729f945 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:48 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7908bc36-957f-4966-9098-24bfb729f945 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:48 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7908bc36-957f-4966-9098-24bfb729f945 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:48 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-7908bc36-957f-4966-9098-24bfb729f945 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.186472 Apr 14 19:00:48 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 255/752] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 19:00:48 2023] GET /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58/os-interface => generated 283 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:00:49 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-e1e56a7b-c15f-4aca-87d5-82e42254cb05 req-1912a328-dd32-4984-a64e-b12eb5764557 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05891511-e84c-4fe3-a688-edcc27849d58", "tag": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:00:49 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-e1e56a7b-c15f-4aca-87d5-82e42254cb05 req-1912a328-dd32-4984-a64e-b12eb5764557 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:49 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-e1e56a7b-c15f-4aca-87d5-82e42254cb05 req-1912a328-dd32-4984-a64e-b12eb5764557 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:49 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-e1e56a7b-c15f-4aca-87d5-82e42254cb05 req-1912a328-dd32-4984-a64e-b12eb5764557 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:49 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:00:49 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-e1e56a7b-c15f-4aca-87d5-82e42254cb05 req-1912a328-dd32-4984-a64e-b12eb5764557 service nova] Creating event network-changed:dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance 05891511-e84c-4fe3-a688-edcc27849d58 on user Apr 14 19:00:49 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-e1e56a7b-c15f-4aca-87d5-82e42254cb05 req-1912a328-dd32-4984-a64e-b12eb5764557 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056858 Apr 14 19:00:49 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 249/753] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:00:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 19:00:49 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61176d19-dc87-4e57-9b3c-6ba547a237eb"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:00:49 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:00:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:49 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "POST /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312766 Apr 14 19:00:49 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 250/754] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 19:00:49 2023] POST /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:00:58 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:00:58 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=6 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:00:58 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:00:58 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:00:58 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-9da44f83-0fe6-47bb-99f6-1d43c2704182 req-73a956a0-4d20-44c1-8ea8-b686530c757a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698bc2dc-aff4-4148-b80e-8b77c846faf7", "name": "network-vif-plugged", "status": "completed", "tag": "dc45a89d-f20f-49e4-a526-0355bb98b37f"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:00:58 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-9da44f83-0fe6-47bb-99f6-1d43c2704182 req-73a956a0-4d20-44c1-8ea8-b686530c757a service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:58 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-9da44f83-0fe6-47bb-99f6-1d43c2704182 req-73a956a0-4d20-44c1-8ea8-b686530c757a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:58 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-9da44f83-0fe6-47bb-99f6-1d43c2704182 req-73a956a0-4d20-44c1-8ea8-b686530c757a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:58 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-9da44f83-0fe6-47bb-99f6-1d43c2704182 req-73a956a0-4d20-44c1-8ea8-b686530c757a service nova] Creating event network-vif-plugged:dc45a89d-f20f-49e4-a526-0355bb98b37f for instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 on user Apr 14 19:00:58 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-9da44f83-0fe6-47bb-99f6-1d43c2704182 req-73a956a0-4d20-44c1-8ea8-b686530c757a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045283 Apr 14 19:00:58 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 256/755] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:00:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:00:59 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:00:59 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:00:59 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:00:59 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=5 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:00:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:59 user devstack@n-api.service[61673]: DEBUG nova.objects.instance [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'flavor' on Instance uuid 05891511-e84c-4fe3-a688-edcc27849d58 {{(pid=61673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 19:00:59 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "POST /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58/action" status: 200 len: 32 microversion: 2.1 time: 0.206484 Apr 14 19:00:59 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 250/756] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 19:00:59 2023] POST /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58/action => generated 32 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 19:00:59 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=3 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:00:59 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-5f190783-88fb-4a67-85b3-1064b3939ea2 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:00:59 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-5f190783-88fb-4a67-85b3-1064b3939ea2 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:00:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-5f190783-88fb-4a67-85b3-1064b3939ea2 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-5f190783-88fb-4a67-85b3-1064b3939ea2 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-5f190783-88fb-4a67-85b3-1064b3939ea2 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:00:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-5f190783-88fb-4a67-85b3-1064b3939ea2 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:00:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-5f190783-88fb-4a67-85b3-1064b3939ea2 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:00:59 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-5f190783-88fb-4a67-85b3-1064b3939ea2 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:00 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-5f190783-88fb-4a67-85b3-1064b3939ea2 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8713ed85ffb4446847f5ded4bc2e399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60e8abd123e414f847c68ba72894689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:01:00 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-5f190783-88fb-4a67-85b3-1064b3939ea2 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58" status: 200 len: 1722 microversion: 2.1 time: 0.703406 Apr 14 19:01:00 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 251/757] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:00:59 2023] GET /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58 => generated 1722 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:01:00 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-4fff539a-939a-4cd3-bc51-088ba912b2db req-05023108-86f8-4a04-a64d-688c5d895990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05891511-e84c-4fe3-a688-edcc27849d58", "name": "network-vif-unplugged", "status": "completed", "tag": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:01:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-4fff539a-939a-4cd3-bc51-088ba912b2db req-05023108-86f8-4a04-a64d-688c5d895990 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-4fff539a-939a-4cd3-bc51-088ba912b2db req-05023108-86f8-4a04-a64d-688c5d895990 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-4fff539a-939a-4cd3-bc51-088ba912b2db req-05023108-86f8-4a04-a64d-688c5d895990 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:00 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-4fff539a-939a-4cd3-bc51-088ba912b2db req-05023108-86f8-4a04-a64d-688c5d895990 service nova] Creating event network-vif-unplugged:dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance 05891511-e84c-4fe3-a688-edcc27849d58 on user Apr 14 19:01:00 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-4fff539a-939a-4cd3-bc51-088ba912b2db req-05023108-86f8-4a04-a64d-688c5d895990 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039948 Apr 14 19:01:00 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 257/758] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:01:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:01:00 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-ee29ab56-b5cc-464b-a305-dfd26f048cc8 req-0ba8f7d6-2201-442f-9d51-9b16abb2b522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698bc2dc-aff4-4148-b80e-8b77c846faf7", "name": "network-vif-plugged", "status": "completed", "tag": "dc45a89d-f20f-49e4-a526-0355bb98b37f"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:01:00 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-ee29ab56-b5cc-464b-a305-dfd26f048cc8 req-0ba8f7d6-2201-442f-9d51-9b16abb2b522 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:00 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-ee29ab56-b5cc-464b-a305-dfd26f048cc8 req-0ba8f7d6-2201-442f-9d51-9b16abb2b522 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:00 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-ee29ab56-b5cc-464b-a305-dfd26f048cc8 req-0ba8f7d6-2201-442f-9d51-9b16abb2b522 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:00 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-ee29ab56-b5cc-464b-a305-dfd26f048cc8 req-0ba8f7d6-2201-442f-9d51-9b16abb2b522 service nova] Creating event network-vif-plugged:dc45a89d-f20f-49e4-a526-0355bb98b37f for instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 on user Apr 14 19:01:00 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-ee29ab56-b5cc-464b-a305-dfd26f048cc8 req-0ba8f7d6-2201-442f-9d51-9b16abb2b522 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031997 Apr 14 19:01:00 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 251/759] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:01:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:01:01 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-a55ce6aa-1f9e-41fa-be8f-a3fcb5ef3f01 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:01:01 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-a55ce6aa-1f9e-41fa-be8f-a3fcb5ef3f01 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:01:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a55ce6aa-1f9e-41fa-be8f-a3fcb5ef3f01 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a55ce6aa-1f9e-41fa-be8f-a3fcb5ef3f01 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a55ce6aa-1f9e-41fa-be8f-a3fcb5ef3f01 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a55ce6aa-1f9e-41fa-be8f-a3fcb5ef3f01 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a55ce6aa-1f9e-41fa-be8f-a3fcb5ef3f01 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a55ce6aa-1f9e-41fa-be8f-a3fcb5ef3f01 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:01 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-a55ce6aa-1f9e-41fa-be8f-a3fcb5ef3f01 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056915 Apr 14 19:01:01 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 252/760] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 19:01:01 2023] GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 19:01:01 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:01:01 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:01:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:01 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Going to try to terminate instance {{(pid=61674) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 19:01:01 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4" status: 204 len: 0 microversion: 2.1 time: 0.232209 Apr 14 19:01:01 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 258/761] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:01:01 2023] DELETE /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 19:01:01 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-b63628e7-f515-40f8-999f-7446d89fba1a tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:01:01 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-b63628e7-f515-40f8-999f-7446d89fba1a tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:01:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b63628e7-f515-40f8-999f-7446d89fba1a tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b63628e7-f515-40f8-999f-7446d89fba1a tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b63628e7-f515-40f8-999f-7446d89fba1a tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b63628e7-f515-40f8-999f-7446d89fba1a tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b63628e7-f515-40f8-999f-7446d89fba1a tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b63628e7-f515-40f8-999f-7446d89fba1a tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:01 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-b63628e7-f515-40f8-999f-7446d89fba1a tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f90c8f23e3b42a98fdb9261db65f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf25bcc0dea4d3eb1284e8995eb3466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:01:01 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-b63628e7-f515-40f8-999f-7446d89fba1a tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4" status: 200 len: 1662 microversion: 2.1 time: 0.423934 Apr 14 19:01:01 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 252/762] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:01:01 2023] GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4 => generated 1662 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:01:02 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-c2f6e150-dd61-40f7-9a37-0edf885d48dc req-933584d0-a010-4f07-9adc-4f66593c9b30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05891511-e84c-4fe3-a688-edcc27849d58", "name": "network-vif-plugged", "status": "completed", "tag": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd"}, {"server_uuid": "0050e6bb-0b53-4fdc-8437-16b94ee79fa4", "name": "network-vif-unplugged", "status": "completed", "tag": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21"}, {"server_uuid": "0050e6bb-0b53-4fdc-8437-16b94ee79fa4", "name": "network-vif-plugged", "status": "completed", "tag": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:01:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-c2f6e150-dd61-40f7-9a37-0edf885d48dc req-933584d0-a010-4f07-9adc-4f66593c9b30 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-c2f6e150-dd61-40f7-9a37-0edf885d48dc req-933584d0-a010-4f07-9adc-4f66593c9b30 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-c2f6e150-dd61-40f7-9a37-0edf885d48dc req-933584d0-a010-4f07-9adc-4f66593c9b30 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:02 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-c2f6e150-dd61-40f7-9a37-0edf885d48dc req-933584d0-a010-4f07-9adc-4f66593c9b30 service nova] Creating event network-vif-plugged:dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance 05891511-e84c-4fe3-a688-edcc27849d58 on user Apr 14 19:01:02 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-c2f6e150-dd61-40f7-9a37-0edf885d48dc req-933584d0-a010-4f07-9adc-4f66593c9b30 service nova] Creating event network-vif-unplugged:2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 on user Apr 14 19:01:02 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-c2f6e150-dd61-40f7-9a37-0edf885d48dc req-933584d0-a010-4f07-9adc-4f66593c9b30 service nova] Creating event network-vif-plugged:2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 on user Apr 14 19:01:02 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-c2f6e150-dd61-40f7-9a37-0edf885d48dc req-933584d0-a010-4f07-9adc-4f66593c9b30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.046187 Apr 14 19:01:02 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 253/763] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:01:02 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:01:04 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-b31dd5b0-8ae1-4dae-a296-a7542ffeecd9 req-a8266610-b301-4e56-b3b8-c0e4f720952b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0050e6bb-0b53-4fdc-8437-16b94ee79fa4", "name": "network-vif-deleted", "tag": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:01:04 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-b31dd5b0-8ae1-4dae-a296-a7542ffeecd9 req-a8266610-b301-4e56-b3b8-c0e4f720952b service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:04 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-b31dd5b0-8ae1-4dae-a296-a7542ffeecd9 req-a8266610-b301-4e56-b3b8-c0e4f720952b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:04 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-b31dd5b0-8ae1-4dae-a296-a7542ffeecd9 req-a8266610-b301-4e56-b3b8-c0e4f720952b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:04 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-b31dd5b0-8ae1-4dae-a296-a7542ffeecd9 req-a8266610-b301-4e56-b3b8-c0e4f720952b service nova] Creating event network-vif-deleted:2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 on user Apr 14 19:01:04 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-b31dd5b0-8ae1-4dae-a296-a7542ffeecd9 req-a8266610-b301-4e56-b3b8-c0e4f720952b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052427 Apr 14 19:01:04 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 259/764] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:01:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 19:01:04 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0050e6bb-0b53-4fdc-8437-16b94ee79fa4", "name": "network-vif-plugged", "status": "completed", "tag": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21"}, {"server_uuid": "0050e6bb-0b53-4fdc-8437-16b94ee79fa4", "name": "network-vif-plugged", "status": "completed", "tag": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21"}, {"server_uuid": "0050e6bb-0b53-4fdc-8437-16b94ee79fa4", "name": "network-vif-unplugged", "status": "completed", "tag": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21"}, {"server_uuid": "0050e6bb-0b53-4fdc-8437-16b94ee79fa4", "name": "network-vif-plugged", "status": "completed", "tag": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21"}, {"server_uuid": "05891511-e84c-4fe3-a688-edcc27849d58", "name": "network-vif-plugged", "status": "completed", "tag": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd"}, {"server_uuid": "05891511-e84c-4fe3-a688-edcc27849d58", "name": "network-vif-plugged", "status": "completed", "tag": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:01:04 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:04 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:04 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:04 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Creating event network-vif-plugged:2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 on user Apr 14 19:01:04 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Creating event network-vif-plugged:2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 on user Apr 14 19:01:04 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Creating event network-vif-unplugged:2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 on user Apr 14 19:01:04 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Creating event network-vif-plugged:2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 on user Apr 14 19:01:04 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Creating event network-vif-plugged:dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance 05891511-e84c-4fe3-a688-edcc27849d58 on user Apr 14 19:01:04 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Creating event network-vif-plugged:dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance 05891511-e84c-4fe3-a688-edcc27849d58 on user Apr 14 19:01:04 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.039918 Apr 14 19:01:04 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 253/765] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:01:04 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:01:13 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=6 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:01:13 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:01:13 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-ed86d50c-1e87-4a4f-8b76-521f8a614190 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1175703061", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "destination_type": "local"}, {"source_type": "volume", "uuid": "894009b5-f0cd-43aa-a75e-12e7b9183e10", "destination_type": "invalid"}], "networks": [{"uuid": "7c02047b-1b40-4937-ac05-13accc969b21"}]}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:01:13 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-ed86d50c-1e87-4a4f-8b76-521f8a614190 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Request method failure captured: Apr 14 19:01:13 user devstack@n-api.service[61675]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 14 19:01:13 user devstack@n-api.service[61675]: Accept: application/json Apr 14 19:01:13 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 19:01:13 user devstack@n-api.service[61675]: Connection: close Apr 14 19:01:13 user devstack@n-api.service[61675]: Content-Length: 494 Apr 14 19:01:13 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 19:01:13 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 19:01:13 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 19:01:13 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 19:01:13 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOaEsY-49_UH_J3mBATqvRVH5dUHcsVSiiVJdSIid9MZeTcpfoMTIknXp2tWw93BGljD6LR0tbGadP9mZK4S9ZtkGPst8WCDv6cC5W-8OVcxLzEvEXPXvJgxmE3G7nRXzVSHsO49YGfr1T4QOGzRokkupbfGrjnTgHd_6oETan9GCdhM Apr 14 19:01:13 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 19:01:13 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 19:01:13 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 19:01:13 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 19:01:13 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 19:01:13 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 19:01:13 user devstack@n-api.service[61675]: X-Project-Id: 4af68184e7654efea3187e05bb10e5e4 Apr 14 19:01:13 user devstack@n-api.service[61675]: X-Project-Name: tempest-ServersNegativeTestJSON-1532814906 Apr 14 19:01:13 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 19:01:13 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 19:01:13 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4af68184e7654efea3187e05bb10e5e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4af68184e7654efea3187e05bb10e5e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4af68184e7654efea3187e05bb10e5e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:01:13 user devstack@n-api.service[61675]: X-Tenant: tempest-ServersNegativeTestJSON-1532814906 Apr 14 19:01:13 user devstack@n-api.service[61675]: X-Tenant-Id: 4af68184e7654efea3187e05bb10e5e4 Apr 14 19:01:13 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1532814906 Apr 14 19:01:13 user devstack@n-api.service[61675]: X-User: tempest-ServersNegativeTestJSON-1532814906-project-member Apr 14 19:01:13 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 19:01:13 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 19:01:13 user devstack@n-api.service[61675]: X-User-Id: 008a24026e844252b0be1268461bc2b1 Apr 14 19:01:13 user devstack@n-api.service[61675]: X-User-Name: tempest-ServersNegativeTestJSON-1532814906-project-member Apr 14 19:01:13 user devstack@n-api.service[61675]: Apr 14 19:01:13 user devstack@n-api.service[61675]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1175703061", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "destination_type": "local"}, {"source_type": "volume", "uuid": "894009b5-f0cd-43aa-a75e-12e7b9183e10", "destination_type": "invalid"}], "networks": [{"uuid": "7c02047b-1b40-4937-ac05-13accc969b21"}]}} Apr 14 19:01:13 user devstack@n-api.service[61675]: method: > Apr 14 19:01:13 user devstack@n-api.service[61675]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 19:01:13 user devstack@n-api.service[61675]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1175703061', 'imageRef': '09ac11b8-b53a-4bc5-8785-aad1f28737d3', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '09ac11b8-b53a-4bc5-8785-aad1f28737d3', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '894009b5-f0cd-43aa-a75e-12e7b9183e10', 'destination_type': 'invalid'}], 'networks': [{'uuid': '7c02047b-1b40-4937-ac05-13accc969b21'}]}}} Apr 14 19:01:13 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise error Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi 'invalid' Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 19:01:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:01:13 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-ed86d50c-1e87-4a4f-8b76-521f8a614190 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:01:13 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-ed86d50c-1e87-4a4f-8b76-521f8a614190 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.014735 Apr 14 19:01:13 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 254/766] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 19:01:13 2023] POST /compute/v2.1/servers => generated 155 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 14 19:01:13 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-5b58b80d-126b-4272-856b-f5aea2c2ee41 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:01:13 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-5b58b80d-126b-4272-856b-f5aea2c2ee41 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:01:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5b58b80d-126b-4272-856b-f5aea2c2ee41 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5b58b80d-126b-4272-856b-f5aea2c2ee41 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5b58b80d-126b-4272-856b-f5aea2c2ee41 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5b58b80d-126b-4272-856b-f5aea2c2ee41 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5b58b80d-126b-4272-856b-f5aea2c2ee41 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5b58b80d-126b-4272-856b-f5aea2c2ee41 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:14 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-5b58b80d-126b-4272-856b-f5aea2c2ee41 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008a24026e844252b0be1268461bc2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af68184e7654efea3187e05bb10e5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:01:14 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-5b58b80d-126b-4272-856b-f5aea2c2ee41 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97aafe40-5587-41cf-ba75-6077d9daa7eb" status: 200 len: 1494 microversion: 2.1 time: 0.306592 Apr 14 19:01:14 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 260/767] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:01:13 2023] GET /compute/v2.1/servers/97aafe40-5587-41cf-ba75-6077d9daa7eb => generated 1494 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:01:16 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-1367b58f-0db5-470f-9cee-a2c7e18d4f76 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:01:16 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-1367b58f-0db5-470f-9cee-a2c7e18d4f76 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:01:16 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=8 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:01:16 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:01:16 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1367b58f-0db5-470f-9cee-a2c7e18d4f76 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:16 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1367b58f-0db5-470f-9cee-a2c7e18d4f76 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:16 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1367b58f-0db5-470f-9cee-a2c7e18d4f76 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:16 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1367b58f-0db5-470f-9cee-a2c7e18d4f76 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:16 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1367b58f-0db5-470f-9cee-a2c7e18d4f76 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:16 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1367b58f-0db5-470f-9cee-a2c7e18d4f76 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:16 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-1367b58f-0db5-470f-9cee-a2c7e18d4f76 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1/action" status: 202 len: 0 microversion: 2.87 time: 0.103583 Apr 14 19:01:16 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 254/768] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 19:01:16 2023] POST /compute/v2.1/servers/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 14 19:01:16 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-dcf1aa1d-ab89-4482-a3c6-6341f3c6a09f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:01:16 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-dcf1aa1d-ab89-4482-a3c6-6341f3c6a09f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:01:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-dcf1aa1d-ab89-4482-a3c6-6341f3c6a09f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-dcf1aa1d-ab89-4482-a3c6-6341f3c6a09f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-dcf1aa1d-ab89-4482-a3c6-6341f3c6a09f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-dcf1aa1d-ab89-4482-a3c6-6341f3c6a09f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-dcf1aa1d-ab89-4482-a3c6-6341f3c6a09f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-dcf1aa1d-ab89-4482-a3c6-6341f3c6a09f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:16 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-dcf1aa1d-ab89-4482-a3c6-6341f3c6a09f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:01:16 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-dcf1aa1d-ab89-4482-a3c6-6341f3c6a09f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:01:16 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-dcf1aa1d-ab89-4482-a3c6-6341f3c6a09f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:01:16 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-dcf1aa1d-ab89-4482-a3c6-6341f3c6a09f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" status: 200 len: 1762 microversion: 2.87 time: 0.265102 Apr 14 19:01:16 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 255/769] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:01:16 2023] GET /compute/v2.1/servers/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 => generated 1762 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 19:01:17 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-160da8e9-530b-475e-b250-dc443bcc50a2 req-31215ca8-bdcb-4264-ad33-a167cf60743d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1", "name": "network-vif-unplugged", "status": "completed", "tag": "3a14f42c-2105-477c-8012-069d489f2d91"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:01:17 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-160da8e9-530b-475e-b250-dc443bcc50a2 req-31215ca8-bdcb-4264-ad33-a167cf60743d service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:17 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-160da8e9-530b-475e-b250-dc443bcc50a2 req-31215ca8-bdcb-4264-ad33-a167cf60743d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:17 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-160da8e9-530b-475e-b250-dc443bcc50a2 req-31215ca8-bdcb-4264-ad33-a167cf60743d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:17 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-160da8e9-530b-475e-b250-dc443bcc50a2 req-31215ca8-bdcb-4264-ad33-a167cf60743d service nova] Creating event network-vif-unplugged:3a14f42c-2105-477c-8012-069d489f2d91 for instance 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 on user Apr 14 19:01:17 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-160da8e9-530b-475e-b250-dc443bcc50a2 req-31215ca8-bdcb-4264-ad33-a167cf60743d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037966 Apr 14 19:01:17 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 261/770] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:01:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:01:19 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-a4e63e2e-ced0-4e9f-b862-9112452dc628 req-737bdaf2-0b39-443a-a0eb-c9781e551bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1", "name": "network-vif-plugged", "status": "completed", "tag": "3a14f42c-2105-477c-8012-069d489f2d91"}, {"server_uuid": "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1", "name": "network-vif-plugged", "status": "completed", "tag": "3a14f42c-2105-477c-8012-069d489f2d91"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:01:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-a4e63e2e-ced0-4e9f-b862-9112452dc628 req-737bdaf2-0b39-443a-a0eb-c9781e551bc6 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-a4e63e2e-ced0-4e9f-b862-9112452dc628 req-737bdaf2-0b39-443a-a0eb-c9781e551bc6 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-a4e63e2e-ced0-4e9f-b862-9112452dc628 req-737bdaf2-0b39-443a-a0eb-c9781e551bc6 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:19 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-a4e63e2e-ced0-4e9f-b862-9112452dc628 req-737bdaf2-0b39-443a-a0eb-c9781e551bc6 service nova] Creating event network-vif-plugged:3a14f42c-2105-477c-8012-069d489f2d91 for instance 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 on user Apr 14 19:01:19 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-a4e63e2e-ced0-4e9f-b862-9112452dc628 req-737bdaf2-0b39-443a-a0eb-c9781e551bc6 service nova] Creating event network-vif-plugged:3a14f42c-2105-477c-8012-069d489f2d91 for instance 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 on user Apr 14 19:01:19 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-a4e63e2e-ced0-4e9f-b862-9112452dc628 req-737bdaf2-0b39-443a-a0eb-c9781e551bc6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036919 Apr 14 19:01:19 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 255/771] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:01:19 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:01:21 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-effc085f-6ae2-4085-b71b-ff2629cf594f req-4553e83a-9b6f-4d62-b114-ce4172d47f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1", "name": "network-vif-plugged", "status": "completed", "tag": "3a14f42c-2105-477c-8012-069d489f2d91"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:01:21 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-effc085f-6ae2-4085-b71b-ff2629cf594f req-4553e83a-9b6f-4d62-b114-ce4172d47f73 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:21 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-effc085f-6ae2-4085-b71b-ff2629cf594f req-4553e83a-9b6f-4d62-b114-ce4172d47f73 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:21 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-effc085f-6ae2-4085-b71b-ff2629cf594f req-4553e83a-9b6f-4d62-b114-ce4172d47f73 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:21 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-effc085f-6ae2-4085-b71b-ff2629cf594f req-4553e83a-9b6f-4d62-b114-ce4172d47f73 service nova] Creating event network-vif-plugged:3a14f42c-2105-477c-8012-069d489f2d91 for instance 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 on user Apr 14 19:01:21 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-effc085f-6ae2-4085-b71b-ff2629cf594f req-4553e83a-9b6f-4d62-b114-ce4172d47f73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043961 Apr 14 19:01:21 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 256/772] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:01:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:01:23 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-1e1e1411-7097-46db-9467-e3443d504794 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:01:23 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-1e1e1411-7097-46db-9467-e3443d504794 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:01:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-1e1e1411-7097-46db-9467-e3443d504794 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-1e1e1411-7097-46db-9467-e3443d504794 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-1e1e1411-7097-46db-9467-e3443d504794 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-1e1e1411-7097-46db-9467-e3443d504794 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-1e1e1411-7097-46db-9467-e3443d504794 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-1e1e1411-7097-46db-9467-e3443d504794 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:23 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-1e1e1411-7097-46db-9467-e3443d504794 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058732 Apr 14 19:01:23 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 262/773] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 19:01:23 2023] GET /compute/v2.1/servers/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 19:01:23 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:01:23 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:01:23 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-74e0c4b8-6a9c-4062-b6de-7c2090cd8552 req-d199f7a3-150a-43b3-b4da-5ceb0904fda5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58", "tag": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:01:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-74e0c4b8-6a9c-4062-b6de-7c2090cd8552 req-d199f7a3-150a-43b3-b4da-5ceb0904fda5 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-74e0c4b8-6a9c-4062-b6de-7c2090cd8552 req-d199f7a3-150a-43b3-b4da-5ceb0904fda5 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-74e0c4b8-6a9c-4062-b6de-7c2090cd8552 req-d199f7a3-150a-43b3-b4da-5ceb0904fda5 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:23 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-74e0c4b8-6a9c-4062-b6de-7c2090cd8552 req-d199f7a3-150a-43b3-b4da-5ceb0904fda5 service nova] Creating event network-changed:9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 for instance 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 on user Apr 14 19:01:23 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-74e0c4b8-6a9c-4062-b6de-7c2090cd8552 req-d199f7a3-150a-43b3-b4da-5ceb0904fda5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038814 Apr 14 19:01:23 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 257/774] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:01:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:01:23 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Going to try to terminate instance {{(pid=61673) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 19:01:24 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" status: 204 len: 0 microversion: 2.1 time: 0.157505 Apr 14 19:01:24 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 256/775] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:01:23 2023] DELETE /compute/v2.1/servers/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 19:01:24 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-25232a48-6af3-44b9-b62a-9b578c67d4ef tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:01:24 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-25232a48-6af3-44b9-b62a-9b578c67d4ef tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:01:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-25232a48-6af3-44b9-b62a-9b578c67d4ef tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-25232a48-6af3-44b9-b62a-9b578c67d4ef tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-25232a48-6af3-44b9-b62a-9b578c67d4ef tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-25232a48-6af3-44b9-b62a-9b578c67d4ef tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-25232a48-6af3-44b9-b62a-9b578c67d4ef tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-25232a48-6af3-44b9-b62a-9b578c67d4ef tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:24 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-25232a48-6af3-44b9-b62a-9b578c67d4ef tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a9414d0c24643fdb162aad828c736bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921435d84194431c886ec1ed1848d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:01:24 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-25232a48-6af3-44b9-b62a-9b578c67d4ef tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" status: 200 len: 1662 microversion: 2.1 time: 0.604741 Apr 14 19:01:24 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 263/776] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:01:24 2023] GET /compute/v2.1/servers/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 => generated 1662 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:01:25 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-0c925d9b-532e-4b2a-8f32-06bb522ab114 req-1fa3af39-ca0d-4c1c-bdb9-3d3f4cb151b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58", "name": "network-vif-deleted", "tag": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:01:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-0c925d9b-532e-4b2a-8f32-06bb522ab114 req-1fa3af39-ca0d-4c1c-bdb9-3d3f4cb151b8 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-0c925d9b-532e-4b2a-8f32-06bb522ab114 req-1fa3af39-ca0d-4c1c-bdb9-3d3f4cb151b8 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-0c925d9b-532e-4b2a-8f32-06bb522ab114 req-1fa3af39-ca0d-4c1c-bdb9-3d3f4cb151b8 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:25 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-0c925d9b-532e-4b2a-8f32-06bb522ab114 req-1fa3af39-ca0d-4c1c-bdb9-3d3f4cb151b8 service nova] Creating event network-vif-deleted:9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 for instance 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 on user Apr 14 19:01:25 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-0c925d9b-532e-4b2a-8f32-06bb522ab114 req-1fa3af39-ca0d-4c1c-bdb9-3d3f4cb151b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041734 Apr 14 19:01:25 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 258/777] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:01:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:01:26 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-f330122c-64ec-4870-98d9-312f400ec86e req-686b2658-44a1-48cd-9041-6c8b736b3f4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58", "name": "network-vif-unplugged", "status": "completed", "tag": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92"}, {"server_uuid": "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58", "name": "network-vif-plugged", "status": "completed", "tag": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:01:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-f330122c-64ec-4870-98d9-312f400ec86e req-686b2658-44a1-48cd-9041-6c8b736b3f4c service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-f330122c-64ec-4870-98d9-312f400ec86e req-686b2658-44a1-48cd-9041-6c8b736b3f4c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-f330122c-64ec-4870-98d9-312f400ec86e req-686b2658-44a1-48cd-9041-6c8b736b3f4c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:26 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-f330122c-64ec-4870-98d9-312f400ec86e req-686b2658-44a1-48cd-9041-6c8b736b3f4c service nova] Creating event network-vif-unplugged:9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 for instance 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 on user Apr 14 19:01:26 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-f330122c-64ec-4870-98d9-312f400ec86e req-686b2658-44a1-48cd-9041-6c8b736b3f4c service nova] Creating event network-vif-plugged:9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 for instance 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 on user Apr 14 19:01:26 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-f330122c-64ec-4870-98d9-312f400ec86e req-686b2658-44a1-48cd-9041-6c8b736b3f4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.037905 Apr 14 19:01:26 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 257/778] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:01:26 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:01:34 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-81ec5aef-2ddb-4dfe-a628-913f395c7474 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:01:34 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-81ec5aef-2ddb-4dfe-a628-913f395c7474 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:01:34 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:01:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-81ec5aef-2ddb-4dfe-a628-913f395c7474 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-81ec5aef-2ddb-4dfe-a628-913f395c7474 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-81ec5aef-2ddb-4dfe-a628-913f395c7474 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-81ec5aef-2ddb-4dfe-a628-913f395c7474 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-81ec5aef-2ddb-4dfe-a628-913f395c7474 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-81ec5aef-2ddb-4dfe-a628-913f395c7474 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:34 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:01:34 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-81ec5aef-2ddb-4dfe-a628-913f395c7474 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:01:34 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-81ec5aef-2ddb-4dfe-a628-913f395c7474 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/698bc2dc-aff4-4148-b80e-8b77c846faf7" status: 200 len: 1549 microversion: 2.1 time: 0.273881 Apr 14 19:01:34 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 264/779] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:01:34 2023] GET /compute/v2.1/servers/698bc2dc-aff4-4148-b80e-8b77c846faf7 => generated 1549 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:01:42 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=10 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:01:42 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=12 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:01:42 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-1fe69787-d110-4987-916d-0bb776a545b9 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:01:42 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-1fe69787-d110-4987-916d-0bb776a545b9 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:01:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1fe69787-d110-4987-916d-0bb776a545b9 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1fe69787-d110-4987-916d-0bb776a545b9 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1fe69787-d110-4987-916d-0bb776a545b9 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1fe69787-d110-4987-916d-0bb776a545b9 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1fe69787-d110-4987-916d-0bb776a545b9 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1fe69787-d110-4987-916d-0bb776a545b9 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:42 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-1fe69787-d110-4987-916d-0bb776a545b9 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46d51513-1995-43c5-976a-40789ae575f1/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.307150 Apr 14 19:01:42 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 259/780] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 19:01:42 2023] GET /compute/v2.1/servers/46d51513-1995-43c5-976a-40789ae575f1/os-interface => generated 282 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:01:43 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:01:43 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:01:43 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-8cb91de3-61b2-4e09-afd8-f2c87737adeb req-a991aaef-4745-4229-90df-d687a9245d7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46d51513-1995-43c5-976a-40789ae575f1", "tag": "48f196d4-dd0c-4499-8b7b-b0c4199cc059"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:01:43 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-8cb91de3-61b2-4e09-afd8-f2c87737adeb req-a991aaef-4745-4229-90df-d687a9245d7f service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:43 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-8cb91de3-61b2-4e09-afd8-f2c87737adeb req-a991aaef-4745-4229-90df-d687a9245d7f service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:43 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-8cb91de3-61b2-4e09-afd8-f2c87737adeb req-a991aaef-4745-4229-90df-d687a9245d7f service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:43 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-8cb91de3-61b2-4e09-afd8-f2c87737adeb req-a991aaef-4745-4229-90df-d687a9245d7f service nova] Creating event network-changed:48f196d4-dd0c-4499-8b7b-b0c4199cc059 for instance 46d51513-1995-43c5-976a-40789ae575f1 on user Apr 14 19:01:43 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-8cb91de3-61b2-4e09-afd8-f2c87737adeb req-a991aaef-4745-4229-90df-d687a9245d7f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119807 Apr 14 19:01:43 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 258/781] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:01:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:01:48 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1675664043", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9"}], "security_groups": [{"name": "tempest-securitygroup--228730137"}], "key_name": "tempest-keypair-1907005832", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "4441ca6a-4e8c-45c6-9669-8db66ae94a39", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:01:48 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:01:48 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=5 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:01:48 user devstack@n-api.service[61674]: DEBUG nova.network.neutron [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] validate_networks() for [('cfabb8bd-6f49-4a21-90ab-ee230e7003a9', None, None, None, None, None)] {{(pid=61674) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 19:01:48 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flavor limits 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 19:01:48 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Image limits 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 19:01:48 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flavor pref 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 19:01:48 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Image pref 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 19:01:48 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 19:01:48 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:48 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:48 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:48 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:48 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:48 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:48 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting quotas for project f028a79640b848228dc6e654a0eef49b. Resources: {'ram', 'instances', 'cores'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 19:01:48 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting quotas for user 55fa4abe2fdd48cb91f39bf8156a7793 and project f028a79640b848228dc6e654a0eef49b. Resources: {'ram', 'instances', 'cores'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 19:01:48 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Going to run 1 instances... {{(pid=61674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 19:01:48 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4441ca6a-4e8c-45c6-9669-8db66ae94a39',volume_size=None,volume_type=None)] {{(pid=61674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 19:01:49 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.878364 Apr 14 19:01:49 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 265/782] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 19:01:48 2023] POST /compute/v2.1/servers => generated 403 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 19:01:49 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-59a5686b-ef9c-428a-8144-a21a5eade310 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:01:49 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-59a5686b-ef9c-428a-8144-a21a5eade310 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:01:49 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-59a5686b-ef9c-428a-8144-a21a5eade310 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:01:49 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-59a5686b-ef9c-428a-8144-a21a5eade310 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468" status: 200 len: 1076 microversion: 2.1 time: 0.076870 Apr 14 19:01:49 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 260/783] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:01:49 2023] GET /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468 => generated 1076 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:01:50 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-f42bcbdc-1120-4949-8aab-54adfb32cb88 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:01:50 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-f42bcbdc-1120-4949-8aab-54adfb32cb88 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:01:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f42bcbdc-1120-4949-8aab-54adfb32cb88 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f42bcbdc-1120-4949-8aab-54adfb32cb88 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f42bcbdc-1120-4949-8aab-54adfb32cb88 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f42bcbdc-1120-4949-8aab-54adfb32cb88 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f42bcbdc-1120-4949-8aab-54adfb32cb88 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f42bcbdc-1120-4949-8aab-54adfb32cb88 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:50 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-f42bcbdc-1120-4949-8aab-54adfb32cb88 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8713ed85ffb4446847f5ded4bc2e399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60e8abd123e414f847c68ba72894689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:01:50 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-f42bcbdc-1120-4949-8aab-54adfb32cb88 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58" status: 200 len: 1702 microversion: 2.1 time: 0.372600 Apr 14 19:01:50 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 259/784] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:01:50 2023] GET /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58 => generated 1702 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:01:51 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-8800b2e0-fdf7-4df0-9828-58f9b8154b6e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:01:51 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-8800b2e0-fdf7-4df0-9828-58f9b8154b6e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:01:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8800b2e0-fdf7-4df0-9828-58f9b8154b6e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8800b2e0-fdf7-4df0-9828-58f9b8154b6e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8800b2e0-fdf7-4df0-9828-58f9b8154b6e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8800b2e0-fdf7-4df0-9828-58f9b8154b6e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8800b2e0-fdf7-4df0-9828-58f9b8154b6e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8800b2e0-fdf7-4df0-9828-58f9b8154b6e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:51 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-8800b2e0-fdf7-4df0-9828-58f9b8154b6e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] HTTP exception thrown: Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 could not be found. Apr 14 19:01:51 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-8800b2e0-fdf7-4df0-9828-58f9b8154b6e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Request method failure captured: Apr 14 19:01:51 user devstack@n-api.service[61674]: request: GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4 HTTP/1.1 Apr 14 19:01:51 user devstack@n-api.service[61674]: Accept: application/json Apr 14 19:01:51 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 19:01:51 user devstack@n-api.service[61674]: Connection: close Apr 14 19:01:51 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 19:01:51 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 19:01:51 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 19:01:51 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 19:01:51 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 19:01:51 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOaCvR0LdZ-tjyVt6oQb6IpAgKVYAlnVECPgmlFqHUNZvZKpQkmNaJw21aRTTyI6wUYicoaM5yM0KU8UJU3OXhqcuiP4L4ZASGKPVL_8u7uHGRlWBAK0UAE8OGdjrOcvkalE_7bVUYOPe7Eh_4yg_nEIAFWChbaZqV4fsXjL7cjmG4FU Apr 14 19:01:51 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 19:01:51 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 19:01:51 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 19:01:51 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 19:01:51 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 19:01:51 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 19:01:51 user devstack@n-api.service[61674]: X-Project-Id: edf25bcc0dea4d3eb1284e8995eb3466 Apr 14 19:01:51 user devstack@n-api.service[61674]: X-Project-Name: tempest-AttachVolumeTestJSON-1126291015 Apr 14 19:01:51 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 19:01:51 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 19:01:51 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/edf25bcc0dea4d3eb1284e8995eb3466"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/edf25bcc0dea4d3eb1284e8995eb3466"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/edf25bcc0dea4d3eb1284e8995eb3466"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:01:51 user devstack@n-api.service[61674]: X-Tenant: tempest-AttachVolumeTestJSON-1126291015 Apr 14 19:01:51 user devstack@n-api.service[61674]: X-Tenant-Id: edf25bcc0dea4d3eb1284e8995eb3466 Apr 14 19:01:51 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1126291015 Apr 14 19:01:51 user devstack@n-api.service[61674]: X-User: tempest-AttachVolumeTestJSON-1126291015-project-member Apr 14 19:01:51 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 19:01:51 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 19:01:51 user devstack@n-api.service[61674]: X-User-Id: 9f90c8f23e3b42a98fdb9261db65f547 Apr 14 19:01:51 user devstack@n-api.service[61674]: X-User-Name: tempest-AttachVolumeTestJSON-1126291015-project-member Apr 14 19:01:51 user devstack@n-api.service[61674]: method: > Apr 14 19:01:51 user devstack@n-api.service[61674]: exception: Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 could not be found. Apr 14 19:01:51 user devstack@n-api.service[61674]: action_args: {'id': '0050e6bb-0b53-4fdc-8437-16b94ee79fa4'} Apr 14 19:01:51 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 could not be found. Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 could not be found. Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 could not be found. Apr 14 19:01:51 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:01:51 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-8800b2e0-fdf7-4df0-9828-58f9b8154b6e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Returning 404 to user: Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:01:51 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-8800b2e0-fdf7-4df0-9828-58f9b8154b6e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4" status: 404 len: 111 microversion: 2.1 time: 0.040152 Apr 14 19:01:51 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 266/785] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:01:51 2023] GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:01:51 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-868ee06e-247f-42a0-803e-a961a3036cf1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '.version_select at 0x7fdae0f17370>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:01:51 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-868ee06e-247f-42a0-803e-a961a3036cf1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1957519464" status: 202 len: 0 microversion: 2.1 time: 0.027121 Apr 14 19:01:51 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 261/786] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 19:01:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1957519464 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 19:01:52 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-6a79a401-5df1-4a1d-b1e8-d3e9894f32fd req-cd44e853-872a-4938-af87-adaed90e0e33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4a54fb1-bd66-42f5-9f8c-9fb40470f468", "tag": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:01:52 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-6a79a401-5df1-4a1d-b1e8-d3e9894f32fd req-cd44e853-872a-4938-af87-adaed90e0e33 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:52 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-6a79a401-5df1-4a1d-b1e8-d3e9894f32fd req-cd44e853-872a-4938-af87-adaed90e0e33 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:52 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-6a79a401-5df1-4a1d-b1e8-d3e9894f32fd req-cd44e853-872a-4938-af87-adaed90e0e33 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:52 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-6a79a401-5df1-4a1d-b1e8-d3e9894f32fd req-cd44e853-872a-4938-af87-adaed90e0e33 service nova] Creating event network-changed:bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 for instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 on user Apr 14 19:01:52 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-6a79a401-5df1-4a1d-b1e8-d3e9894f32fd req-cd44e853-872a-4938-af87-adaed90e0e33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128423 Apr 14 19:01:52 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 260/787] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:01:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:01:53 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-e6d1fde1-12c5-481d-bfb3-99754a684531 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Action: 'create', calling method: .version_select at 0x7fdae1174040>, body: {"keypair": {"name": "tempest-keypair-1109149281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8HTfZpcc8mgXo4AFnwhG4K4/O/z3QrzgEBaxKd3TyzfRmFooJLVotAQ5vypXEppo8BUy020ij2j7iBnMQIFDslNGH0Kg+6YUYeTL3M4R8QHGfv3cvG6Xoj82DMjalKAA=="}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:01:53 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-e6d1fde1-12c5-481d-bfb3-99754a684531 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Getting quotas for project edf25bcc0dea4d3eb1284e8995eb3466. Resources: {'key_pairs'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 19:01:53 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-e6d1fde1-12c5-481d-bfb3-99754a684531 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Getting quotas for user 9f90c8f23e3b42a98fdb9261db65f547 and project edf25bcc0dea4d3eb1284e8995eb3466. Resources: {'key_pairs'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 19:01:53 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-e6d1fde1-12c5-481d-bfb3-99754a684531 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052174 Apr 14 19:01:53 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 267/788] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 19:01:53 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:01:54 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=4 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:01:54 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2038797611", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "05575fea-953f-4063-8670-e146f7767b37"}], "security_groups": [{"name": "tempest-securitygroup--1919472214"}], "key_name": "tempest-keypair-1109149281", "user_data": "}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:01:54 user devstack@n-api.service[61675]: DEBUG nova.network.neutron [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] validate_networks() for [('05575fea-953f-4063-8670-e146f7767b37', None, None, None, None, None)] {{(pid=61675) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 19:01:55 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Flavor limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 19:01:55 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Image limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 19:01:55 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Flavor pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 19:01:55 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Image pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 19:01:55 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 19:01:55 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:55 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:55 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:55 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:55 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:55 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:55 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Getting quotas for project edf25bcc0dea4d3eb1284e8995eb3466. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 19:01:55 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Getting quotas for user 9f90c8f23e3b42a98fdb9261db65f547 and project edf25bcc0dea4d3eb1284e8995eb3466. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 19:01:55 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Going to run 1 instances... {{(pid=61675) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 19:01:55 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 19:01:55 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.647492 Apr 14 19:01:55 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 262/789] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 19:01:54 2023] POST /compute/v2.1/servers => generated 400 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 19:01:55 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-ffcc8daa-c940-43c3-9115-db85aed481d0 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:01:55 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-ffcc8daa-c940-43c3-9115-db85aed481d0 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:01:55 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-ffcc8daa-c940-43c3-9115-db85aed481d0 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f90c8f23e3b42a98fdb9261db65f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf25bcc0dea4d3eb1284e8995eb3466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:01:55 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-ffcc8daa-c940-43c3-9115-db85aed481d0 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f" status: 200 len: 1232 microversion: 2.1 time: 0.074388 Apr 14 19:01:55 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 261/790] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:01:55 2023] GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f => generated 1232 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:01:59 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-79de34e8-fc29-4899-a1f7-bdc447be4cb1 req-85ba358b-e513-4ef9-87ab-3365eda9f464 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15ebad56-cad0-4ab3-853f-72e3a3d2117f", "tag": "08acb0d5-2432-42fe-a372-78f11a73ed56"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:01:59 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:01:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-79de34e8-fc29-4899-a1f7-bdc447be4cb1 req-85ba358b-e513-4ef9-87ab-3365eda9f464 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:01:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-79de34e8-fc29-4899-a1f7-bdc447be4cb1 req-85ba358b-e513-4ef9-87ab-3365eda9f464 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:01:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-79de34e8-fc29-4899-a1f7-bdc447be4cb1 req-85ba358b-e513-4ef9-87ab-3365eda9f464 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:01:59 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-79de34e8-fc29-4899-a1f7-bdc447be4cb1 req-85ba358b-e513-4ef9-87ab-3365eda9f464 service nova] Creating event network-changed:08acb0d5-2432-42fe-a372-78f11a73ed56 for instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f on user Apr 14 19:01:59 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-79de34e8-fc29-4899-a1f7-bdc447be4cb1 req-85ba358b-e513-4ef9-87ab-3365eda9f464 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034610 Apr 14 19:01:59 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 268/791] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:01:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:02:01 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-9441f3fd-a3f5-4240-b483-506c0fd634c7 req-502def1e-131f-4506-bd21-caa8cdf3a825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ebad56-cad0-4ab3-853f-72e3a3d2117f", "name": "network-vif-plugged", "status": "completed", "tag": "08acb0d5-2432-42fe-a372-78f11a73ed56"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:02:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-9441f3fd-a3f5-4240-b483-506c0fd634c7 req-502def1e-131f-4506-bd21-caa8cdf3a825 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-9441f3fd-a3f5-4240-b483-506c0fd634c7 req-502def1e-131f-4506-bd21-caa8cdf3a825 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-9441f3fd-a3f5-4240-b483-506c0fd634c7 req-502def1e-131f-4506-bd21-caa8cdf3a825 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:01 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-9441f3fd-a3f5-4240-b483-506c0fd634c7 req-502def1e-131f-4506-bd21-caa8cdf3a825 service nova] Creating event network-vif-plugged:08acb0d5-2432-42fe-a372-78f11a73ed56 for instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f on user Apr 14 19:02:01 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-9441f3fd-a3f5-4240-b483-506c0fd634c7 req-502def1e-131f-4506-bd21-caa8cdf3a825 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054847 Apr 14 19:02:01 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 263/792] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:02:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:02:03 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-78bf8976-81c1-4bb4-ba8d-db604d1f742e req-e13eb429-8824-4917-8206-b2b108bdfcd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ebad56-cad0-4ab3-853f-72e3a3d2117f", "name": "network-vif-plugged", "status": "completed", "tag": "08acb0d5-2432-42fe-a372-78f11a73ed56"}, {"server_uuid": "d4a54fb1-bd66-42f5-9f8c-9fb40470f468", "name": "network-vif-plugged", "status": "completed", "tag": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2"}, {"server_uuid": "d4a54fb1-bd66-42f5-9f8c-9fb40470f468", "name": "network-vif-plugged", "status": "completed", "tag": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:02:03 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=10 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:02:03 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-78bf8976-81c1-4bb4-ba8d-db604d1f742e req-e13eb429-8824-4917-8206-b2b108bdfcd3 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:03 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-78bf8976-81c1-4bb4-ba8d-db604d1f742e req-e13eb429-8824-4917-8206-b2b108bdfcd3 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:03 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-78bf8976-81c1-4bb4-ba8d-db604d1f742e req-e13eb429-8824-4917-8206-b2b108bdfcd3 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:03 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-78bf8976-81c1-4bb4-ba8d-db604d1f742e req-e13eb429-8824-4917-8206-b2b108bdfcd3 service nova] Creating event network-vif-plugged:08acb0d5-2432-42fe-a372-78f11a73ed56 for instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f on user Apr 14 19:02:03 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-78bf8976-81c1-4bb4-ba8d-db604d1f742e req-e13eb429-8824-4917-8206-b2b108bdfcd3 service nova] Creating event network-vif-plugged:bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 for instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 on user Apr 14 19:02:03 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-78bf8976-81c1-4bb4-ba8d-db604d1f742e req-e13eb429-8824-4917-8206-b2b108bdfcd3 service nova] Creating event network-vif-plugged:bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 for instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 on user Apr 14 19:02:03 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-78bf8976-81c1-4bb4-ba8d-db604d1f742e req-e13eb429-8824-4917-8206-b2b108bdfcd3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.038676 Apr 14 19:02:03 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 262/793] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:02:03 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:02:06 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=10 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:02:06 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-62e0cac9-174d-409b-a588-85a53f3341fc tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:02:06 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-62e0cac9-174d-409b-a588-85a53f3341fc tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:02:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-62e0cac9-174d-409b-a588-85a53f3341fc tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-62e0cac9-174d-409b-a588-85a53f3341fc tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-62e0cac9-174d-409b-a588-85a53f3341fc tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-62e0cac9-174d-409b-a588-85a53f3341fc tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-62e0cac9-174d-409b-a588-85a53f3341fc tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-62e0cac9-174d-409b-a588-85a53f3341fc tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:07 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-62e0cac9-174d-409b-a588-85a53f3341fc tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:02:07 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-62e0cac9-174d-409b-a588-85a53f3341fc tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:02:07 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-62e0cac9-174d-409b-a588-85a53f3341fc tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:02:07 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-62e0cac9-174d-409b-a588-85a53f3341fc tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" status: 200 len: 1768 microversion: 2.87 time: 0.608498 Apr 14 19:02:07 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 269/794] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:02:06 2023] GET /compute/v2.1/servers/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 => generated 1768 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 19:02:14 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-795359f5-ce55-4230-9c40-a18686aca435 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:02:14 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-795359f5-ce55-4230-9c40-a18686aca435 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:02:14 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:02:14 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=8 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:02:14 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:02:14 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=4 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:02:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-795359f5-ce55-4230-9c40-a18686aca435 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-795359f5-ce55-4230-9c40-a18686aca435 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-795359f5-ce55-4230-9c40-a18686aca435 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-795359f5-ce55-4230-9c40-a18686aca435 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-795359f5-ce55-4230-9c40-a18686aca435 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-795359f5-ce55-4230-9c40-a18686aca435 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:14 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-795359f5-ce55-4230-9c40-a18686aca435 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] HTTP exception thrown: Instance 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 could not be found. Apr 14 19:02:14 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-795359f5-ce55-4230-9c40-a18686aca435 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Request method failure captured: Apr 14 19:02:14 user devstack@n-api.service[61675]: request: GET /compute/v2.1/servers/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 HTTP/1.1 Apr 14 19:02:14 user devstack@n-api.service[61675]: Accept: application/json Apr 14 19:02:14 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 19:02:14 user devstack@n-api.service[61675]: Connection: close Apr 14 19:02:14 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 19:02:14 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 19:02:14 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 19:02:14 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 19:02:14 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 19:02:14 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOaGNnePEq1MpwMLxXNyF4LOeXDJn61FOEBZ2tU-sdoW52xSWoc9fdzInbjmjI0NsKBhFG_b4MIZUnz81qLIWMIWkCQqtat-0Oe54LrtV8g2-CLEh546LjB2jMSHj6ba6aDXVKxF0V_H5nlAqW2ihRNa1ZwT2u0E01W2xidj7i2PG2vs Apr 14 19:02:14 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 19:02:14 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 19:02:14 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 19:02:14 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 19:02:14 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 19:02:14 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 19:02:14 user devstack@n-api.service[61675]: X-Project-Id: 921435d84194431c886ec1ed1848d4d6 Apr 14 19:02:14 user devstack@n-api.service[61675]: X-Project-Name: tempest-TestStampPattern-251531447 Apr 14 19:02:14 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 19:02:14 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 19:02:14 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/921435d84194431c886ec1ed1848d4d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/921435d84194431c886ec1ed1848d4d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/921435d84194431c886ec1ed1848d4d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:02:14 user devstack@n-api.service[61675]: X-Tenant: tempest-TestStampPattern-251531447 Apr 14 19:02:14 user devstack@n-api.service[61675]: X-Tenant-Id: 921435d84194431c886ec1ed1848d4d6 Apr 14 19:02:14 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-TestStampPattern-251531447 Apr 14 19:02:14 user devstack@n-api.service[61675]: X-User: tempest-TestStampPattern-251531447-project-member Apr 14 19:02:14 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 19:02:14 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 19:02:14 user devstack@n-api.service[61675]: X-User-Id: 9a9414d0c24643fdb162aad828c736bd Apr 14 19:02:14 user devstack@n-api.service[61675]: X-User-Name: tempest-TestStampPattern-251531447-project-member Apr 14 19:02:14 user devstack@n-api.service[61675]: method: > Apr 14 19:02:14 user devstack@n-api.service[61675]: exception: Instance 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 could not be found. Apr 14 19:02:14 user devstack@n-api.service[61675]: action_args: {'id': '48e2cdcb-9b4a-458b-95d7-47ef29dd6b58'} Apr 14 19:02:14 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 could not be found. Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 could not be found. Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 could not be found. Apr 14 19:02:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:02:14 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-795359f5-ce55-4230-9c40-a18686aca435 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Returning 404 to user: Instance 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:02:14 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-795359f5-ce55-4230-9c40-a18686aca435 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" status: 404 len: 111 microversion: 2.1 time: 0.060936 Apr 14 19:02:14 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 264/795] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:02:14 2023] GET /compute/v2.1/servers/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:02:21 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:02:21 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=12 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:02:21 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:02:21 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-046a2997-cd47-470f-8887-4131c721ae9b tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:02:21 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-046a2997-cd47-470f-8887-4131c721ae9b tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:02:21 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-046a2997-cd47-470f-8887-4131c721ae9b tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:21 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-046a2997-cd47-470f-8887-4131c721ae9b tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:21 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-046a2997-cd47-470f-8887-4131c721ae9b tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:21 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-046a2997-cd47-470f-8887-4131c721ae9b tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:21 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-046a2997-cd47-470f-8887-4131c721ae9b tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:21 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-046a2997-cd47-470f-8887-4131c721ae9b tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:21 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-046a2997-cd47-470f-8887-4131c721ae9b tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] HTTP exception thrown: Instance 8832a321-f1ac-411a-8fc9-1fc816bffec6 could not be found. Apr 14 19:02:21 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-046a2997-cd47-470f-8887-4131c721ae9b tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Request method failure captured: Apr 14 19:02:21 user devstack@n-api.service[61673]: request: DELETE /compute/v2.1/servers/8832a321-f1ac-411a-8fc9-1fc816bffec6 HTTP/1.1 Apr 14 19:02:21 user devstack@n-api.service[61673]: Accept: application/json Apr 14 19:02:21 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 19:02:21 user devstack@n-api.service[61673]: Connection: close Apr 14 19:02:21 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 19:02:21 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 19:02:21 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 19:02:21 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 19:02:21 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 19:02:21 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOaEsY-49_UH_J3mBATqvRVH5dUHcsVSiiVJdSIid9MZeTcpfoMTIknXp2tWw93BGljD6LR0tbGadP9mZK4S9ZtkGPst8WCDv6cC5W-8OVcxLzEvEXPXvJgxmE3G7nRXzVSHsO49YGfr1T4QOGzRokkupbfGrjnTgHd_6oETan9GCdhM Apr 14 19:02:21 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 19:02:21 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 19:02:21 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 19:02:21 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 19:02:21 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 19:02:21 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 19:02:21 user devstack@n-api.service[61673]: X-Project-Id: 4af68184e7654efea3187e05bb10e5e4 Apr 14 19:02:21 user devstack@n-api.service[61673]: X-Project-Name: tempest-ServersNegativeTestJSON-1532814906 Apr 14 19:02:21 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 19:02:21 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 19:02:21 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4af68184e7654efea3187e05bb10e5e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4af68184e7654efea3187e05bb10e5e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4af68184e7654efea3187e05bb10e5e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:02:21 user devstack@n-api.service[61673]: X-Tenant: tempest-ServersNegativeTestJSON-1532814906 Apr 14 19:02:21 user devstack@n-api.service[61673]: X-Tenant-Id: 4af68184e7654efea3187e05bb10e5e4 Apr 14 19:02:21 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1532814906 Apr 14 19:02:21 user devstack@n-api.service[61673]: X-User: tempest-ServersNegativeTestJSON-1532814906-project-member Apr 14 19:02:21 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 19:02:21 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 19:02:21 user devstack@n-api.service[61673]: X-User-Id: 008a24026e844252b0be1268461bc2b1 Apr 14 19:02:21 user devstack@n-api.service[61673]: X-User-Name: tempest-ServersNegativeTestJSON-1532814906-project-member Apr 14 19:02:21 user devstack@n-api.service[61673]: method: > Apr 14 19:02:21 user devstack@n-api.service[61673]: exception: Instance 8832a321-f1ac-411a-8fc9-1fc816bffec6 could not be found. Apr 14 19:02:21 user devstack@n-api.service[61673]: action_args: {'id': '8832a321-f1ac-411a-8fc9-1fc816bffec6'} Apr 14 19:02:21 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8832a321-f1ac-411a-8fc9-1fc816bffec6 could not be found. Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8832a321-f1ac-411a-8fc9-1fc816bffec6 could not be found. Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8832a321-f1ac-411a-8fc9-1fc816bffec6 could not be found. Apr 14 19:02:21 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:02:21 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-046a2997-cd47-470f-8887-4131c721ae9b tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Returning 404 to user: Instance 8832a321-f1ac-411a-8fc9-1fc816bffec6 could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:02:21 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-046a2997-cd47-470f-8887-4131c721ae9b tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8832a321-f1ac-411a-8fc9-1fc816bffec6" status: 404 len: 111 microversion: 2.1 time: 0.037619 Apr 14 19:02:21 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 263/796] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:02:21 2023] DELETE /compute/v2.1/servers/8832a321-f1ac-411a-8fc9-1fc816bffec6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:02:21 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-972e5161-8aa6-4a48-ad87-5b12586e1a2c tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:02:21 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-972e5161-8aa6-4a48-ad87-5b12586e1a2c tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:02:21 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=12 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:02:21 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=4 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:02:21 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-972e5161-8aa6-4a48-ad87-5b12586e1a2c tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:21 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-972e5161-8aa6-4a48-ad87-5b12586e1a2c tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:21 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-972e5161-8aa6-4a48-ad87-5b12586e1a2c tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:21 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-972e5161-8aa6-4a48-ad87-5b12586e1a2c tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:21 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-972e5161-8aa6-4a48-ad87-5b12586e1a2c tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:21 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-972e5161-8aa6-4a48-ad87-5b12586e1a2c tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:21 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-972e5161-8aa6-4a48-ad87-5b12586e1a2c tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] HTTP exception thrown: Instance 8832a321-f1ac-411a-8fc9-1fc816bffec6 could not be found. Apr 14 19:02:21 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-972e5161-8aa6-4a48-ad87-5b12586e1a2c tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Request method failure captured: Apr 14 19:02:21 user devstack@n-api.service[61674]: request: GET /compute/v2.1/servers/8832a321-f1ac-411a-8fc9-1fc816bffec6 HTTP/1.1 Apr 14 19:02:21 user devstack@n-api.service[61674]: Accept: application/json Apr 14 19:02:21 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 19:02:21 user devstack@n-api.service[61674]: Connection: close Apr 14 19:02:21 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 19:02:21 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 19:02:21 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 19:02:21 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 19:02:21 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 19:02:21 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOaEsY-49_UH_J3mBATqvRVH5dUHcsVSiiVJdSIid9MZeTcpfoMTIknXp2tWw93BGljD6LR0tbGadP9mZK4S9ZtkGPst8WCDv6cC5W-8OVcxLzEvEXPXvJgxmE3G7nRXzVSHsO49YGfr1T4QOGzRokkupbfGrjnTgHd_6oETan9GCdhM Apr 14 19:02:21 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 19:02:21 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 19:02:21 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 19:02:21 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 19:02:21 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 19:02:21 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 19:02:21 user devstack@n-api.service[61674]: X-Project-Id: 4af68184e7654efea3187e05bb10e5e4 Apr 14 19:02:21 user devstack@n-api.service[61674]: X-Project-Name: tempest-ServersNegativeTestJSON-1532814906 Apr 14 19:02:21 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 19:02:21 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 19:02:21 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4af68184e7654efea3187e05bb10e5e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4af68184e7654efea3187e05bb10e5e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4af68184e7654efea3187e05bb10e5e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:02:21 user devstack@n-api.service[61674]: X-Tenant: tempest-ServersNegativeTestJSON-1532814906 Apr 14 19:02:21 user devstack@n-api.service[61674]: X-Tenant-Id: 4af68184e7654efea3187e05bb10e5e4 Apr 14 19:02:21 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1532814906 Apr 14 19:02:21 user devstack@n-api.service[61674]: X-User: tempest-ServersNegativeTestJSON-1532814906-project-member Apr 14 19:02:21 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 19:02:21 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 19:02:21 user devstack@n-api.service[61674]: X-User-Id: 008a24026e844252b0be1268461bc2b1 Apr 14 19:02:21 user devstack@n-api.service[61674]: X-User-Name: tempest-ServersNegativeTestJSON-1532814906-project-member Apr 14 19:02:21 user devstack@n-api.service[61674]: method: > Apr 14 19:02:21 user devstack@n-api.service[61674]: exception: Instance 8832a321-f1ac-411a-8fc9-1fc816bffec6 could not be found. Apr 14 19:02:21 user devstack@n-api.service[61674]: action_args: {'id': '8832a321-f1ac-411a-8fc9-1fc816bffec6'} Apr 14 19:02:21 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8832a321-f1ac-411a-8fc9-1fc816bffec6 could not be found. Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8832a321-f1ac-411a-8fc9-1fc816bffec6 could not be found. Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8832a321-f1ac-411a-8fc9-1fc816bffec6 could not be found. Apr 14 19:02:21 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:02:21 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-972e5161-8aa6-4a48-ad87-5b12586e1a2c tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Returning 404 to user: Instance 8832a321-f1ac-411a-8fc9-1fc816bffec6 could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:02:21 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-972e5161-8aa6-4a48-ad87-5b12586e1a2c tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8832a321-f1ac-411a-8fc9-1fc816bffec6" status: 404 len: 111 microversion: 2.1 time: 0.045862 Apr 14 19:02:21 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 270/797] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:02:21 2023] GET /compute/v2.1/servers/8832a321-f1ac-411a-8fc9-1fc816bffec6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:02:22 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:02:22 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:02:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:22 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Going to try to terminate instance {{(pid=61675) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 19:02:22 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/97aafe40-5587-41cf-ba75-6077d9daa7eb" status: 204 len: 0 microversion: 2.1 time: 0.153003 Apr 14 19:02:22 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 265/798] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:02:21 2023] DELETE /compute/v2.1/servers/97aafe40-5587-41cf-ba75-6077d9daa7eb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 19:02:22 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-a09fc35e-3d71-4210-b49d-1e9db7e0b504 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:02:22 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-a09fc35e-3d71-4210-b49d-1e9db7e0b504 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:02:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a09fc35e-3d71-4210-b49d-1e9db7e0b504 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a09fc35e-3d71-4210-b49d-1e9db7e0b504 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a09fc35e-3d71-4210-b49d-1e9db7e0b504 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a09fc35e-3d71-4210-b49d-1e9db7e0b504 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a09fc35e-3d71-4210-b49d-1e9db7e0b504 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a09fc35e-3d71-4210-b49d-1e9db7e0b504 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:22 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-a09fc35e-3d71-4210-b49d-1e9db7e0b504 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '008a24026e844252b0be1268461bc2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af68184e7654efea3187e05bb10e5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:02:22 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-a09fc35e-3d71-4210-b49d-1e9db7e0b504 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97aafe40-5587-41cf-ba75-6077d9daa7eb" status: 200 len: 1500 microversion: 2.1 time: 0.263216 Apr 14 19:02:22 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 264/799] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:02:22 2023] GET /compute/v2.1/servers/97aafe40-5587-41cf-ba75-6077d9daa7eb => generated 1500 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:02:22 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-512597fc-8461-488a-9496-5f2e38d17f77 req-dbcf3a61-5fb4-4c8b-be02-212797e6d5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97aafe40-5587-41cf-ba75-6077d9daa7eb", "name": "network-vif-unplugged", "status": "completed", "tag": "00a6b78f-1816-4b0f-956b-3dc23b029449"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:02:22 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-512597fc-8461-488a-9496-5f2e38d17f77 req-dbcf3a61-5fb4-4c8b-be02-212797e6d5c2 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:22 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-512597fc-8461-488a-9496-5f2e38d17f77 req-dbcf3a61-5fb4-4c8b-be02-212797e6d5c2 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:22 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-512597fc-8461-488a-9496-5f2e38d17f77 req-dbcf3a61-5fb4-4c8b-be02-212797e6d5c2 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:22 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-512597fc-8461-488a-9496-5f2e38d17f77 req-dbcf3a61-5fb4-4c8b-be02-212797e6d5c2 service nova] Creating event network-vif-unplugged:00a6b78f-1816-4b0f-956b-3dc23b029449 for instance 97aafe40-5587-41cf-ba75-6077d9daa7eb on user Apr 14 19:02:22 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-512597fc-8461-488a-9496-5f2e38d17f77 req-dbcf3a61-5fb4-4c8b-be02-212797e6d5c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034959 Apr 14 19:02:22 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 271/800] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:02:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:02:22 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-9b0b8456-cc11-426b-b505-839a94e2d87e tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:02:22 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-9b0b8456-cc11-426b-b505-839a94e2d87e tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:02:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9b0b8456-cc11-426b-b505-839a94e2d87e tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9b0b8456-cc11-426b-b505-839a94e2d87e tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9b0b8456-cc11-426b-b505-839a94e2d87e tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9b0b8456-cc11-426b-b505-839a94e2d87e tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9b0b8456-cc11-426b-b505-839a94e2d87e tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9b0b8456-cc11-426b-b505-839a94e2d87e tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:22 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-9b0b8456-cc11-426b-b505-839a94e2d87e tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] HTTP exception thrown: Instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 is not attached to volume f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 Apr 14 19:02:22 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-9b0b8456-cc11-426b-b505-839a94e2d87e tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Request method failure captured: Apr 14 19:02:22 user devstack@n-api.service[61675]: request: DELETE /compute/v2.1/servers/1feb4399-a5dc-43a7-ac78-4d22809e2737/os-volume_attachments/f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 HTTP/1.1 Apr 14 19:02:22 user devstack@n-api.service[61675]: Accept: application/json Apr 14 19:02:22 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 19:02:22 user devstack@n-api.service[61675]: Connection: close Apr 14 19:02:22 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 19:02:22 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 19:02:22 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 19:02:22 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 19:02:22 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 19:02:22 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOaGNnePEq1MpwMLxXNyF4LOeXDJn61FOEBZ2tU-sdoW52xSWoc9fdzInbjmjI0NsKBhFG_b4MIZUnz81qLIWMIWkCQqtat-0Oe54LrtV8g2-CLEh546LjB2jMSHj6ba6aDXVKxF0V_H5nlAqW2ihRNa1ZwT2u0E01W2xidj7i2PG2vs Apr 14 19:02:22 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 19:02:22 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 19:02:22 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 19:02:22 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 19:02:22 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 19:02:22 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 19:02:22 user devstack@n-api.service[61675]: X-Project-Id: 921435d84194431c886ec1ed1848d4d6 Apr 14 19:02:22 user devstack@n-api.service[61675]: X-Project-Name: tempest-TestStampPattern-251531447 Apr 14 19:02:22 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 19:02:22 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 19:02:22 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/921435d84194431c886ec1ed1848d4d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/921435d84194431c886ec1ed1848d4d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/921435d84194431c886ec1ed1848d4d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:02:22 user devstack@n-api.service[61675]: X-Tenant: tempest-TestStampPattern-251531447 Apr 14 19:02:22 user devstack@n-api.service[61675]: X-Tenant-Id: 921435d84194431c886ec1ed1848d4d6 Apr 14 19:02:22 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-TestStampPattern-251531447 Apr 14 19:02:22 user devstack@n-api.service[61675]: X-User: tempest-TestStampPattern-251531447-project-member Apr 14 19:02:22 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 19:02:22 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 19:02:22 user devstack@n-api.service[61675]: X-User-Id: 9a9414d0c24643fdb162aad828c736bd Apr 14 19:02:22 user devstack@n-api.service[61675]: X-User-Name: tempest-TestStampPattern-251531447-project-member Apr 14 19:02:22 user devstack@n-api.service[61675]: method: > Apr 14 19:02:22 user devstack@n-api.service[61675]: exception: Instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 is not attached to volume f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 Apr 14 19:02:22 user devstack@n-api.service[61675]: action_args: {'server_id': '1feb4399-a5dc-43a7-ac78-4d22809e2737', 'id': 'f70d8b48-53a5-4ce4-bc42-2e4bf34d3695'} Apr 14 19:02:22 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f70d8b48-53a5-4ce4-bc42-2e4bf34d3695. Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 is not attached to volume f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 is not attached to volume f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 Apr 14 19:02:22 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:02:22 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-9b0b8456-cc11-426b-b505-839a94e2d87e tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Returning 404 to user: Instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 is not attached to volume f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:02:22 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-9b0b8456-cc11-426b-b505-839a94e2d87e tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1feb4399-a5dc-43a7-ac78-4d22809e2737/os-volume_attachments/f70d8b48-53a5-4ce4-bc42-2e4bf34d3695" status: 404 len: 154 microversion: 2.1 time: 0.104648 Apr 14 19:02:22 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 266/801] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 19:02:22 2023] DELETE /compute/v2.1/servers/1feb4399-a5dc-43a7-ac78-4d22809e2737/os-volume_attachments/f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:02:23 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:02:23 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:02:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:23 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Going to try to terminate instance {{(pid=61673) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 19:02:23 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-b1c05ef3-dc36-4907-b48d-49f26e849e2b req-39506ecc-2c16-442e-8efa-707794b78cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1feb4399-a5dc-43a7-ac78-4d22809e2737", "tag": "99fafc78-521b-4f9c-81fe-9571483238c1"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:02:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-b1c05ef3-dc36-4907-b48d-49f26e849e2b req-39506ecc-2c16-442e-8efa-707794b78cf9 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-b1c05ef3-dc36-4907-b48d-49f26e849e2b req-39506ecc-2c16-442e-8efa-707794b78cf9 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:23 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-b1c05ef3-dc36-4907-b48d-49f26e849e2b req-39506ecc-2c16-442e-8efa-707794b78cf9 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:23 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1feb4399-a5dc-43a7-ac78-4d22809e2737" status: 204 len: 0 microversion: 2.1 time: 0.177002 Apr 14 19:02:23 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 265/802] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:02:23 2023] DELETE /compute/v2.1/servers/1feb4399-a5dc-43a7-ac78-4d22809e2737 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 19:02:23 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-b1c05ef3-dc36-4907-b48d-49f26e849e2b req-39506ecc-2c16-442e-8efa-707794b78cf9 service nova] Creating event network-changed:99fafc78-521b-4f9c-81fe-9571483238c1 for instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 on user Apr 14 19:02:23 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-b1c05ef3-dc36-4907-b48d-49f26e849e2b req-39506ecc-2c16-442e-8efa-707794b78cf9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179947 Apr 14 19:02:23 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 272/803] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:02:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:02:23 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-2f760b64-f86f-4a82-ba83-899ce7367b7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:02:23 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-2f760b64-f86f-4a82-ba83-899ce7367b7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:02:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2f760b64-f86f-4a82-ba83-899ce7367b7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2f760b64-f86f-4a82-ba83-899ce7367b7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2f760b64-f86f-4a82-ba83-899ce7367b7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2f760b64-f86f-4a82-ba83-899ce7367b7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2f760b64-f86f-4a82-ba83-899ce7367b7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2f760b64-f86f-4a82-ba83-899ce7367b7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:23 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-2f760b64-f86f-4a82-ba83-899ce7367b7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a9414d0c24643fdb162aad828c736bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921435d84194431c886ec1ed1848d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:02:23 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-2f760b64-f86f-4a82-ba83-899ce7367b7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1feb4399-a5dc-43a7-ac78-4d22809e2737" status: 200 len: 1660 microversion: 2.1 time: 0.284434 Apr 14 19:02:23 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 267/804] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:02:23 2023] GET /compute/v2.1/servers/1feb4399-a5dc-43a7-ac78-4d22809e2737 => generated 1660 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:02:23 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-41d23025-824d-400c-88b1-0ef6eb31bed2 req-95448242-98cb-4117-97ed-7e3df347754d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97aafe40-5587-41cf-ba75-6077d9daa7eb", "name": "network-vif-deleted", "tag": "00a6b78f-1816-4b0f-956b-3dc23b029449"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:02:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-41d23025-824d-400c-88b1-0ef6eb31bed2 req-95448242-98cb-4117-97ed-7e3df347754d service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-41d23025-824d-400c-88b1-0ef6eb31bed2 req-95448242-98cb-4117-97ed-7e3df347754d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-41d23025-824d-400c-88b1-0ef6eb31bed2 req-95448242-98cb-4117-97ed-7e3df347754d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:24 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-41d23025-824d-400c-88b1-0ef6eb31bed2 req-95448242-98cb-4117-97ed-7e3df347754d service nova] Creating event network-vif-deleted:00a6b78f-1816-4b0f-956b-3dc23b029449 for instance 97aafe40-5587-41cf-ba75-6077d9daa7eb on user Apr 14 19:02:24 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-41d23025-824d-400c-88b1-0ef6eb31bed2 req-95448242-98cb-4117-97ed-7e3df347754d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050661 Apr 14 19:02:24 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 266/805] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:02:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:02:24 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-5385fbca-04e0-4c04-98a4-ce69c0098384 req-a627acce-867a-4b57-bad5-9a5852b8af4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97aafe40-5587-41cf-ba75-6077d9daa7eb", "name": "network-vif-plugged", "status": "completed", "tag": "00a6b78f-1816-4b0f-956b-3dc23b029449"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:02:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-5385fbca-04e0-4c04-98a4-ce69c0098384 req-a627acce-867a-4b57-bad5-9a5852b8af4b service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-5385fbca-04e0-4c04-98a4-ce69c0098384 req-a627acce-867a-4b57-bad5-9a5852b8af4b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-5385fbca-04e0-4c04-98a4-ce69c0098384 req-a627acce-867a-4b57-bad5-9a5852b8af4b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:24 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-5385fbca-04e0-4c04-98a4-ce69c0098384 req-a627acce-867a-4b57-bad5-9a5852b8af4b service nova] Creating event network-vif-plugged:00a6b78f-1816-4b0f-956b-3dc23b029449 for instance 97aafe40-5587-41cf-ba75-6077d9daa7eb on user Apr 14 19:02:24 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-5385fbca-04e0-4c04-98a4-ce69c0098384 req-a627acce-867a-4b57-bad5-9a5852b8af4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064788 Apr 14 19:02:24 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 273/806] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:02:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:02:26 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1feb4399-a5dc-43a7-ac78-4d22809e2737", "name": "network-vif-unplugged", "status": "completed", "tag": "99fafc78-521b-4f9c-81fe-9571483238c1"}, {"server_uuid": "1feb4399-a5dc-43a7-ac78-4d22809e2737", "name": "network-vif-plugged", "status": "completed", "tag": "99fafc78-521b-4f9c-81fe-9571483238c1"}, {"server_uuid": "1feb4399-a5dc-43a7-ac78-4d22809e2737", "name": "network-vif-plugged", "status": "completed", "tag": "99fafc78-521b-4f9c-81fe-9571483238c1"}, {"server_uuid": "1feb4399-a5dc-43a7-ac78-4d22809e2737", "name": "network-vif-plugged", "status": "completed", "tag": "99fafc78-521b-4f9c-81fe-9571483238c1"}, {"server_uuid": "1feb4399-a5dc-43a7-ac78-4d22809e2737", "name": "network-vif-deleted", "tag": "99fafc78-521b-4f9c-81fe-9571483238c1"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:02:26 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:26 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:26 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:26 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] Creating event network-vif-unplugged:99fafc78-521b-4f9c-81fe-9571483238c1 for instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 on user Apr 14 19:02:26 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] Creating event network-vif-plugged:99fafc78-521b-4f9c-81fe-9571483238c1 for instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 on user Apr 14 19:02:26 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] Creating event network-vif-plugged:99fafc78-521b-4f9c-81fe-9571483238c1 for instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 on user Apr 14 19:02:26 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] Creating event network-vif-plugged:99fafc78-521b-4f9c-81fe-9571483238c1 for instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 on user Apr 14 19:02:26 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] Creating event network-vif-deleted:99fafc78-521b-4f9c-81fe-9571483238c1 for instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 on user Apr 14 19:02:26 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.034609 Apr 14 19:02:26 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 268/807] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:02:26 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:02:34 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:02:34 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:02:34 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-56c581e4-f852-4fdf-9756-27cf8d8c172f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:02:34 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-56c581e4-f852-4fdf-9756-27cf8d8c172f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:02:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-56c581e4-f852-4fdf-9756-27cf8d8c172f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-56c581e4-f852-4fdf-9756-27cf8d8c172f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-56c581e4-f852-4fdf-9756-27cf8d8c172f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-56c581e4-f852-4fdf-9756-27cf8d8c172f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-56c581e4-f852-4fdf-9756-27cf8d8c172f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-56c581e4-f852-4fdf-9756-27cf8d8c172f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:34 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-56c581e4-f852-4fdf-9756-27cf8d8c172f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:02:34 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-56c581e4-f852-4fdf-9756-27cf8d8c172f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/698bc2dc-aff4-4148-b80e-8b77c846faf7" status: 200 len: 1549 microversion: 2.1 time: 0.246706 Apr 14 19:02:34 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 267/808] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:02:34 2023] GET /compute/v2.1/servers/698bc2dc-aff4-4148-b80e-8b77c846faf7 => generated 1549 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:02:34 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:02:34 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:02:34 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=8 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:02:34 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=8 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:02:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:34 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Going to try to terminate instance {{(pid=61674) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 19:02:34 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/698bc2dc-aff4-4148-b80e-8b77c846faf7" status: 204 len: 0 microversion: 2.1 time: 0.204454 Apr 14 19:02:34 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 274/809] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:02:34 2023] DELETE /compute/v2.1/servers/698bc2dc-aff4-4148-b80e-8b77c846faf7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 19:02:35 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-7f059925-bef6-4920-9f7d-1edf096a74c5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:02:35 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-7f059925-bef6-4920-9f7d-1edf096a74c5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:02:35 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7f059925-bef6-4920-9f7d-1edf096a74c5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:35 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7f059925-bef6-4920-9f7d-1edf096a74c5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:35 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7f059925-bef6-4920-9f7d-1edf096a74c5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:35 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7f059925-bef6-4920-9f7d-1edf096a74c5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:35 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7f059925-bef6-4920-9f7d-1edf096a74c5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:35 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7f059925-bef6-4920-9f7d-1edf096a74c5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:35 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-efa887ee-2462-4230-9c92-12a25e53e725 req-b87de3cb-a92a-4799-94b3-d373dd66102d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698bc2dc-aff4-4148-b80e-8b77c846faf7", "name": "network-vif-unplugged", "status": "completed", "tag": "dc45a89d-f20f-49e4-a526-0355bb98b37f"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:02:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-efa887ee-2462-4230-9c92-12a25e53e725 req-b87de3cb-a92a-4799-94b3-d373dd66102d service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-efa887ee-2462-4230-9c92-12a25e53e725 req-b87de3cb-a92a-4799-94b3-d373dd66102d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-efa887ee-2462-4230-9c92-12a25e53e725 req-b87de3cb-a92a-4799-94b3-d373dd66102d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:35 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-efa887ee-2462-4230-9c92-12a25e53e725 req-b87de3cb-a92a-4799-94b3-d373dd66102d service nova] Creating event network-vif-unplugged:dc45a89d-f20f-49e4-a526-0355bb98b37f for instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 on user Apr 14 19:02:35 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-efa887ee-2462-4230-9c92-12a25e53e725 req-b87de3cb-a92a-4799-94b3-d373dd66102d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034171 Apr 14 19:02:35 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 268/810] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:02:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:02:35 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-7f059925-bef6-4920-9f7d-1edf096a74c5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:02:35 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-7f059925-bef6-4920-9f7d-1edf096a74c5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/698bc2dc-aff4-4148-b80e-8b77c846faf7" status: 200 len: 1555 microversion: 2.1 time: 0.379646 Apr 14 19:02:35 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 269/811] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:02:34 2023] GET /compute/v2.1/servers/698bc2dc-aff4-4148-b80e-8b77c846faf7 => generated 1555 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:02:37 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698bc2dc-aff4-4148-b80e-8b77c846faf7", "name": "network-vif-plugged", "status": "completed", "tag": "dc45a89d-f20f-49e4-a526-0355bb98b37f"}, {"server_uuid": "698bc2dc-aff4-4148-b80e-8b77c846faf7", "name": "network-vif-plugged", "status": "completed", "tag": "dc45a89d-f20f-49e4-a526-0355bb98b37f"}, {"server_uuid": "698bc2dc-aff4-4148-b80e-8b77c846faf7", "name": "network-vif-plugged", "status": "completed", "tag": "dc45a89d-f20f-49e4-a526-0355bb98b37f"}, {"server_uuid": "698bc2dc-aff4-4148-b80e-8b77c846faf7", "name": "network-vif-unplugged", "status": "completed", "tag": "dc45a89d-f20f-49e4-a526-0355bb98b37f"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:02:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:37 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] Creating event network-vif-plugged:dc45a89d-f20f-49e4-a526-0355bb98b37f for instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 on user Apr 14 19:02:37 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] Creating event network-vif-plugged:dc45a89d-f20f-49e4-a526-0355bb98b37f for instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 on user Apr 14 19:02:37 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] Creating event network-vif-plugged:dc45a89d-f20f-49e4-a526-0355bb98b37f for instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 on user Apr 14 19:02:37 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] Creating event network-vif-unplugged:dc45a89d-f20f-49e4-a526-0355bb98b37f for instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 on user Apr 14 19:02:37 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.065212 Apr 14 19:02:37 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 275/812] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:02:37 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:02:39 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-4ffeaedc-a309-40df-8c02-580e70e8c24a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:02:39 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-4ffeaedc-a309-40df-8c02-580e70e8c24a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:02:39 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4ffeaedc-a309-40df-8c02-580e70e8c24a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:39 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4ffeaedc-a309-40df-8c02-580e70e8c24a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:39 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4ffeaedc-a309-40df-8c02-580e70e8c24a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:39 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4ffeaedc-a309-40df-8c02-580e70e8c24a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:39 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4ffeaedc-a309-40df-8c02-580e70e8c24a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:39 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4ffeaedc-a309-40df-8c02-580e70e8c24a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:39 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-d7a8987b-d701-4032-89be-2dd7c9c6ed00 req-1be8e99a-9313-4501-b811-704b3adf8273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698bc2dc-aff4-4148-b80e-8b77c846faf7", "name": "network-vif-plugged", "status": "completed", "tag": "dc45a89d-f20f-49e4-a526-0355bb98b37f"}, {"server_uuid": "698bc2dc-aff4-4148-b80e-8b77c846faf7", "name": "network-vif-deleted", "tag": "dc45a89d-f20f-49e4-a526-0355bb98b37f"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:02:39 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-d7a8987b-d701-4032-89be-2dd7c9c6ed00 req-1be8e99a-9313-4501-b811-704b3adf8273 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:39 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-d7a8987b-d701-4032-89be-2dd7c9c6ed00 req-1be8e99a-9313-4501-b811-704b3adf8273 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:39 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-d7a8987b-d701-4032-89be-2dd7c9c6ed00 req-1be8e99a-9313-4501-b811-704b3adf8273 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:39 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-d7a8987b-d701-4032-89be-2dd7c9c6ed00 req-1be8e99a-9313-4501-b811-704b3adf8273 service nova] Creating event network-vif-plugged:dc45a89d-f20f-49e4-a526-0355bb98b37f for instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 on user Apr 14 19:02:39 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-d7a8987b-d701-4032-89be-2dd7c9c6ed00 req-1be8e99a-9313-4501-b811-704b3adf8273 service nova] Creating event network-vif-deleted:dc45a89d-f20f-49e4-a526-0355bb98b37f for instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 on user Apr 14 19:02:39 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-d7a8987b-d701-4032-89be-2dd7c9c6ed00 req-1be8e99a-9313-4501-b811-704b3adf8273 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.103502 Apr 14 19:02:39 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 270/813] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:02:39 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:02:39 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-4ffeaedc-a309-40df-8c02-580e70e8c24a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:02:39 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-4ffeaedc-a309-40df-8c02-580e70e8c24a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468" status: 200 len: 1429 microversion: 2.1 time: 0.328287 Apr 14 19:02:39 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 269/814] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:02:39 2023] GET /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468 => generated 1429 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:02:45 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-24658941-3f6f-4151-a1e7-0d75ab5072d8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:02:45 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-24658941-3f6f-4151-a1e7-0d75ab5072d8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:02:45 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-24658941-3f6f-4151-a1e7-0d75ab5072d8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:45 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-24658941-3f6f-4151-a1e7-0d75ab5072d8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:45 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-24658941-3f6f-4151-a1e7-0d75ab5072d8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:45 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-24658941-3f6f-4151-a1e7-0d75ab5072d8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:45 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-24658941-3f6f-4151-a1e7-0d75ab5072d8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:45 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-24658941-3f6f-4151-a1e7-0d75ab5072d8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:45 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-24658941-3f6f-4151-a1e7-0d75ab5072d8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f90c8f23e3b42a98fdb9261db65f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf25bcc0dea4d3eb1284e8995eb3466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:02:45 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-24658941-3f6f-4151-a1e7-0d75ab5072d8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f" status: 200 len: 1538 microversion: 2.1 time: 0.349092 Apr 14 19:02:45 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 276/815] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:02:45 2023] GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f => generated 1538 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:02:50 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:02:50 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:02:50 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-d0e48758-8ddf-4655-b36b-69bc023408e4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:02:50 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-d0e48758-8ddf-4655-b36b-69bc023408e4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:02:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d0e48758-8ddf-4655-b36b-69bc023408e4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d0e48758-8ddf-4655-b36b-69bc023408e4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d0e48758-8ddf-4655-b36b-69bc023408e4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d0e48758-8ddf-4655-b36b-69bc023408e4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d0e48758-8ddf-4655-b36b-69bc023408e4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d0e48758-8ddf-4655-b36b-69bc023408e4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:50 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-d0e48758-8ddf-4655-b36b-69bc023408e4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] HTTP exception thrown: Cannot 'detach_volume' instance 05891511-e84c-4fe3-a688-edcc27849d58 while it is in vm_state rescued Apr 14 19:02:50 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-d0e48758-8ddf-4655-b36b-69bc023408e4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Request method failure captured: Apr 14 19:02:50 user devstack@n-api.service[61675]: request: DELETE /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58/os-volume_attachments/61176d19-dc87-4e57-9b3c-6ba547a237eb HTTP/1.1 Apr 14 19:02:50 user devstack@n-api.service[61675]: Accept: application/json Apr 14 19:02:50 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 19:02:50 user devstack@n-api.service[61675]: Connection: close Apr 14 19:02:50 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 19:02:50 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 19:02:50 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 19:02:50 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 19:02:50 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 19:02:50 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOaBsVI_nvkyYSUnUpk_9LZivhBf1YZK5uRUFFR2iv7YLDTugI5hWoRijQ-9F1cI4hDuKdzxQWbf2lUpXfxiTO1q10jdi5iIMybz9kkHtzg_mWEjrwYVtbLI2p_4_sZODWdXkFWOQ0NLBMotwKrDrF_4nfgQcIHiwUOtMf5a-BxmB6jA Apr 14 19:02:50 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 19:02:50 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 19:02:50 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 19:02:50 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 19:02:50 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 19:02:50 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 19:02:50 user devstack@n-api.service[61675]: X-Project-Id: e60e8abd123e414f847c68ba72894689 Apr 14 19:02:50 user devstack@n-api.service[61675]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1174646715 Apr 14 19:02:50 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 19:02:50 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 19:02:50 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e60e8abd123e414f847c68ba72894689"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e60e8abd123e414f847c68ba72894689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e60e8abd123e414f847c68ba72894689"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:02:50 user devstack@n-api.service[61675]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1174646715 Apr 14 19:02:50 user devstack@n-api.service[61675]: X-Tenant-Id: e60e8abd123e414f847c68ba72894689 Apr 14 19:02:50 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1174646715 Apr 14 19:02:50 user devstack@n-api.service[61675]: X-User: tempest-ServerRescueNegativeTestJSON-1174646715-project-member Apr 14 19:02:50 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 19:02:50 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 19:02:50 user devstack@n-api.service[61675]: X-User-Id: c8713ed85ffb4446847f5ded4bc2e399 Apr 14 19:02:50 user devstack@n-api.service[61675]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1174646715-project-member Apr 14 19:02:50 user devstack@n-api.service[61675]: method: > Apr 14 19:02:50 user devstack@n-api.service[61675]: exception: Cannot 'detach_volume' instance 05891511-e84c-4fe3-a688-edcc27849d58 while it is in vm_state rescued Apr 14 19:02:50 user devstack@n-api.service[61675]: action_args: {'server_id': '05891511-e84c-4fe3-a688-edcc27849d58', 'id': '61176d19-dc87-4e57-9b3c-6ba547a237eb'} Apr 14 19:02:50 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 05891511-e84c-4fe3-a688-edcc27849d58 in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 05891511-e84c-4fe3-a688-edcc27849d58 while it is in vm_state rescued Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 05891511-e84c-4fe3-a688-edcc27849d58 while it is in vm_state rescued Apr 14 19:02:50 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:02:50 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-d0e48758-8ddf-4655-b36b-69bc023408e4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Returning 409 to user: Cannot 'detach_volume' instance 05891511-e84c-4fe3-a688-edcc27849d58 while it is in vm_state rescued {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:02:50 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-d0e48758-8ddf-4655-b36b-69bc023408e4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58/os-volume_attachments/61176d19-dc87-4e57-9b3c-6ba547a237eb" status: 409 len: 152 microversion: 2.1 time: 0.111840 Apr 14 19:02:50 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 271/816] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 19:02:50 2023] DELETE /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58/os-volume_attachments/61176d19-dc87-4e57-9b3c-6ba547a237eb => generated 152 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 14 19:02:50 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-da4da2a9-475b-4657-b085-162a0c5333ba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:02:50 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-da4da2a9-475b-4657-b085-162a0c5333ba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:02:50 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=6 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:02:50 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=14 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:02:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-da4da2a9-475b-4657-b085-162a0c5333ba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-da4da2a9-475b-4657-b085-162a0c5333ba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-da4da2a9-475b-4657-b085-162a0c5333ba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-da4da2a9-475b-4657-b085-162a0c5333ba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-da4da2a9-475b-4657-b085-162a0c5333ba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-da4da2a9-475b-4657-b085-162a0c5333ba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:51 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-da4da2a9-475b-4657-b085-162a0c5333ba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "POST /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58/action" status: 202 len: 0 microversion: 2.1 time: 0.076942 Apr 14 19:02:51 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 270/817] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 19:02:50 2023] POST /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 19:02:51 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-8166655f-6a96-468f-a507-a05744637ea9 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:02:51 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-8166655f-6a96-468f-a507-a05744637ea9 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:02:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8166655f-6a96-468f-a507-a05744637ea9 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8166655f-6a96-468f-a507-a05744637ea9 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8166655f-6a96-468f-a507-a05744637ea9 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8166655f-6a96-468f-a507-a05744637ea9 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8166655f-6a96-468f-a507-a05744637ea9 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8166655f-6a96-468f-a507-a05744637ea9 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:51 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-8166655f-6a96-468f-a507-a05744637ea9 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8713ed85ffb4446847f5ded4bc2e399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60e8abd123e414f847c68ba72894689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:02:51 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-8166655f-6a96-468f-a507-a05744637ea9 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58" status: 200 len: 1710 microversion: 2.1 time: 0.235953 Apr 14 19:02:51 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 277/818] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:02:51 2023] GET /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58 => generated 1710 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 19:02:51 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-9656608a-eaf5-4707-9c8d-c32bb5be34ae req-b9a98108-0752-4540-877f-f44107b3f9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05891511-e84c-4fe3-a688-edcc27849d58", "name": "network-vif-unplugged", "status": "completed", "tag": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:02:51 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-9656608a-eaf5-4707-9c8d-c32bb5be34ae req-b9a98108-0752-4540-877f-f44107b3f9a2 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:51 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-9656608a-eaf5-4707-9c8d-c32bb5be34ae req-b9a98108-0752-4540-877f-f44107b3f9a2 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:51 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-9656608a-eaf5-4707-9c8d-c32bb5be34ae req-b9a98108-0752-4540-877f-f44107b3f9a2 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:51 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-9656608a-eaf5-4707-9c8d-c32bb5be34ae req-b9a98108-0752-4540-877f-f44107b3f9a2 service nova] Creating event network-vif-unplugged:dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance 05891511-e84c-4fe3-a688-edcc27849d58 on user Apr 14 19:02:51 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-9656608a-eaf5-4707-9c8d-c32bb5be34ae req-b9a98108-0752-4540-877f-f44107b3f9a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028967 Apr 14 19:02:51 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 272/819] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:02:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:02:53 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-a3edc6f9-4401-4138-8d60-dcb8de4bd165 req-f8852982-1c96-4019-a354-c3efd82f6aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05891511-e84c-4fe3-a688-edcc27849d58", "name": "network-vif-plugged", "status": "completed", "tag": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd"}, {"server_uuid": "05891511-e84c-4fe3-a688-edcc27849d58", "name": "network-vif-plugged", "status": "completed", "tag": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:02:53 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-a3edc6f9-4401-4138-8d60-dcb8de4bd165 req-f8852982-1c96-4019-a354-c3efd82f6aee service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:53 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-a3edc6f9-4401-4138-8d60-dcb8de4bd165 req-f8852982-1c96-4019-a354-c3efd82f6aee service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:53 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-a3edc6f9-4401-4138-8d60-dcb8de4bd165 req-f8852982-1c96-4019-a354-c3efd82f6aee service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:53 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-a3edc6f9-4401-4138-8d60-dcb8de4bd165 req-f8852982-1c96-4019-a354-c3efd82f6aee service nova] Creating event network-vif-plugged:dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance 05891511-e84c-4fe3-a688-edcc27849d58 on user Apr 14 19:02:53 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-a3edc6f9-4401-4138-8d60-dcb8de4bd165 req-f8852982-1c96-4019-a354-c3efd82f6aee service nova] Creating event network-vif-plugged:dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance 05891511-e84c-4fe3-a688-edcc27849d58 on user Apr 14 19:02:53 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-a3edc6f9-4401-4138-8d60-dcb8de4bd165 req-f8852982-1c96-4019-a354-c3efd82f6aee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032349 Apr 14 19:02:53 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 271/820] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:02:53 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:02:55 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-6c7516ca-c960-468d-a3c5-b4e64c5ff7dd req-31cb13b1-8c0f-41eb-a55e-3fd4f4a9865a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05891511-e84c-4fe3-a688-edcc27849d58", "name": "network-vif-plugged", "status": "completed", "tag": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:02:55 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6c7516ca-c960-468d-a3c5-b4e64c5ff7dd req-31cb13b1-8c0f-41eb-a55e-3fd4f4a9865a service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:02:55 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6c7516ca-c960-468d-a3c5-b4e64c5ff7dd req-31cb13b1-8c0f-41eb-a55e-3fd4f4a9865a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:02:55 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6c7516ca-c960-468d-a3c5-b4e64c5ff7dd req-31cb13b1-8c0f-41eb-a55e-3fd4f4a9865a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:02:55 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-6c7516ca-c960-468d-a3c5-b4e64c5ff7dd req-31cb13b1-8c0f-41eb-a55e-3fd4f4a9865a service nova] Creating event network-vif-plugged:dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance 05891511-e84c-4fe3-a688-edcc27849d58 on user Apr 14 19:02:55 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-6c7516ca-c960-468d-a3c5-b4e64c5ff7dd req-31cb13b1-8c0f-41eb-a55e-3fd4f4a9865a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034438 Apr 14 19:02:55 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 278/821] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:02:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:03:07 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=4 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:03:07 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=8 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:03:07 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:03:07 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:03:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:07 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:07 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Going to try to terminate instance {{(pid=61675) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 19:03:07 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" status: 204 len: 0 microversion: 2.87 time: 0.295899 Apr 14 19:03:07 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 273/822] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 19:03:07 2023] DELETE /compute/v2.1/servers/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 19:03:07 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=4 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:03:07 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:03:07 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-6628ee44-af52-4c62-9123-0432c4213e93 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:03:07 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-6628ee44-af52-4c62-9123-0432c4213e93 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:03:07 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6628ee44-af52-4c62-9123-0432c4213e93 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:07 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6628ee44-af52-4c62-9123-0432c4213e93 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:07 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6628ee44-af52-4c62-9123-0432c4213e93 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:07 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6628ee44-af52-4c62-9123-0432c4213e93 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:07 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6628ee44-af52-4c62-9123-0432c4213e93 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:07 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6628ee44-af52-4c62-9123-0432c4213e93 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:08 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-6628ee44-af52-4c62-9123-0432c4213e93 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:03:08 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-6628ee44-af52-4c62-9123-0432c4213e93 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:03:08 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-6628ee44-af52-4c62-9123-0432c4213e93 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:03:08 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:03:08 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:03:08 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-6628ee44-af52-4c62-9123-0432c4213e93 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" status: 200 len: 1774 microversion: 2.87 time: 0.354764 Apr 14 19:03:08 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 272/823] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:03:07 2023] GET /compute/v2.1/servers/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 => generated 1774 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 19:03:08 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-4af84f30-d977-46e7-a597-6b6f7dc8eb3e req-ec253b56-7f0f-4547-af40-dc0089cf515a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1", "name": "network-vif-unplugged", "status": "completed", "tag": "3a14f42c-2105-477c-8012-069d489f2d91"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:03:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-4af84f30-d977-46e7-a597-6b6f7dc8eb3e req-ec253b56-7f0f-4547-af40-dc0089cf515a service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-4af84f30-d977-46e7-a597-6b6f7dc8eb3e req-ec253b56-7f0f-4547-af40-dc0089cf515a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-4af84f30-d977-46e7-a597-6b6f7dc8eb3e req-ec253b56-7f0f-4547-af40-dc0089cf515a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:08 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-4af84f30-d977-46e7-a597-6b6f7dc8eb3e req-ec253b56-7f0f-4547-af40-dc0089cf515a service nova] Creating event network-vif-unplugged:3a14f42c-2105-477c-8012-069d489f2d91 for instance 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 on user Apr 14 19:03:08 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-4af84f30-d977-46e7-a597-6b6f7dc8eb3e req-ec253b56-7f0f-4547-af40-dc0089cf515a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038013 Apr 14 19:03:08 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 279/824] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:03:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:03:09 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-8d90d497-1f51-40c7-adfc-3174991a97a6 req-6fe95b3a-fe4c-4c03-8f08-2ba3644f0a1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1", "name": "network-vif-deleted", "tag": "3a14f42c-2105-477c-8012-069d489f2d91"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:03:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-8d90d497-1f51-40c7-adfc-3174991a97a6 req-6fe95b3a-fe4c-4c03-8f08-2ba3644f0a1c service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-8d90d497-1f51-40c7-adfc-3174991a97a6 req-6fe95b3a-fe4c-4c03-8f08-2ba3644f0a1c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-8d90d497-1f51-40c7-adfc-3174991a97a6 req-6fe95b3a-fe4c-4c03-8f08-2ba3644f0a1c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:09 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-8d90d497-1f51-40c7-adfc-3174991a97a6 req-6fe95b3a-fe4c-4c03-8f08-2ba3644f0a1c service nova] Creating event network-vif-deleted:3a14f42c-2105-477c-8012-069d489f2d91 for instance 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 on user Apr 14 19:03:09 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-8d90d497-1f51-40c7-adfc-3174991a97a6 req-6fe95b3a-fe4c-4c03-8f08-2ba3644f0a1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033762 Apr 14 19:03:09 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 274/825] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:03:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:03:10 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-f39fca00-05a5-44f7-8f47-c2a4aa7a152f req-ef0e9e31-8106-45c4-bdf4-90d6228706c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1", "name": "network-vif-plugged", "status": "completed", "tag": "3a14f42c-2105-477c-8012-069d489f2d91"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:03:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-f39fca00-05a5-44f7-8f47-c2a4aa7a152f req-ef0e9e31-8106-45c4-bdf4-90d6228706c8 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-f39fca00-05a5-44f7-8f47-c2a4aa7a152f req-ef0e9e31-8106-45c4-bdf4-90d6228706c8 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-f39fca00-05a5-44f7-8f47-c2a4aa7a152f req-ef0e9e31-8106-45c4-bdf4-90d6228706c8 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:10 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-f39fca00-05a5-44f7-8f47-c2a4aa7a152f req-ef0e9e31-8106-45c4-bdf4-90d6228706c8 service nova] Creating event network-vif-plugged:3a14f42c-2105-477c-8012-069d489f2d91 for instance 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 on user Apr 14 19:03:10 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-f39fca00-05a5-44f7-8f47-c2a4aa7a152f req-ef0e9e31-8106-45c4-bdf4-90d6228706c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037004 Apr 14 19:03:10 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 273/826] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:03:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:03:12 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-1cfb51c9-9cab-4805-b9a2-c5db8b6bdc58 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:03:12 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-1cfb51c9-9cab-4805-b9a2-c5db8b6bdc58 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:03:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-1cfb51c9-9cab-4805-b9a2-c5db8b6bdc58 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-1cfb51c9-9cab-4805-b9a2-c5db8b6bdc58 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-1cfb51c9-9cab-4805-b9a2-c5db8b6bdc58 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-1cfb51c9-9cab-4805-b9a2-c5db8b6bdc58 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-1cfb51c9-9cab-4805-b9a2-c5db8b6bdc58 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:12 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-1cfb51c9-9cab-4805-b9a2-c5db8b6bdc58 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:12 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-1cfb51c9-9cab-4805-b9a2-c5db8b6bdc58 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] HTTP exception thrown: Instance 97aafe40-5587-41cf-ba75-6077d9daa7eb could not be found. Apr 14 19:03:12 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-1cfb51c9-9cab-4805-b9a2-c5db8b6bdc58 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Request method failure captured: Apr 14 19:03:12 user devstack@n-api.service[61674]: request: GET /compute/v2.1/servers/97aafe40-5587-41cf-ba75-6077d9daa7eb HTTP/1.1 Apr 14 19:03:12 user devstack@n-api.service[61674]: Accept: application/json Apr 14 19:03:12 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 19:03:12 user devstack@n-api.service[61674]: Connection: close Apr 14 19:03:12 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 19:03:12 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 19:03:12 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 19:03:12 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 19:03:12 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 19:03:12 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOaEsY-49_UH_J3mBATqvRVH5dUHcsVSiiVJdSIid9MZeTcpfoMTIknXp2tWw93BGljD6LR0tbGadP9mZK4S9ZtkGPst8WCDv6cC5W-8OVcxLzEvEXPXvJgxmE3G7nRXzVSHsO49YGfr1T4QOGzRokkupbfGrjnTgHd_6oETan9GCdhM Apr 14 19:03:12 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 19:03:12 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 19:03:12 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 19:03:12 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 19:03:12 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 19:03:12 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 19:03:12 user devstack@n-api.service[61674]: X-Project-Id: 4af68184e7654efea3187e05bb10e5e4 Apr 14 19:03:12 user devstack@n-api.service[61674]: X-Project-Name: tempest-ServersNegativeTestJSON-1532814906 Apr 14 19:03:12 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 19:03:12 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 19:03:12 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4af68184e7654efea3187e05bb10e5e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4af68184e7654efea3187e05bb10e5e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4af68184e7654efea3187e05bb10e5e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:03:12 user devstack@n-api.service[61674]: X-Tenant: tempest-ServersNegativeTestJSON-1532814906 Apr 14 19:03:12 user devstack@n-api.service[61674]: X-Tenant-Id: 4af68184e7654efea3187e05bb10e5e4 Apr 14 19:03:12 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1532814906 Apr 14 19:03:12 user devstack@n-api.service[61674]: X-User: tempest-ServersNegativeTestJSON-1532814906-project-member Apr 14 19:03:12 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 19:03:12 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 19:03:12 user devstack@n-api.service[61674]: X-User-Id: 008a24026e844252b0be1268461bc2b1 Apr 14 19:03:12 user devstack@n-api.service[61674]: X-User-Name: tempest-ServersNegativeTestJSON-1532814906-project-member Apr 14 19:03:12 user devstack@n-api.service[61674]: method: > Apr 14 19:03:12 user devstack@n-api.service[61674]: exception: Instance 97aafe40-5587-41cf-ba75-6077d9daa7eb could not be found. Apr 14 19:03:12 user devstack@n-api.service[61674]: action_args: {'id': '97aafe40-5587-41cf-ba75-6077d9daa7eb'} Apr 14 19:03:12 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97aafe40-5587-41cf-ba75-6077d9daa7eb could not be found. Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97aafe40-5587-41cf-ba75-6077d9daa7eb could not be found. Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97aafe40-5587-41cf-ba75-6077d9daa7eb could not be found. Apr 14 19:03:12 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:03:12 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-1cfb51c9-9cab-4805-b9a2-c5db8b6bdc58 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Returning 404 to user: Instance 97aafe40-5587-41cf-ba75-6077d9daa7eb could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:03:12 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-1cfb51c9-9cab-4805-b9a2-c5db8b6bdc58 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97aafe40-5587-41cf-ba75-6077d9daa7eb" status: 404 len: 111 microversion: 2.1 time: 0.030162 Apr 14 19:03:12 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 280/827] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:03:12 2023] GET /compute/v2.1/servers/97aafe40-5587-41cf-ba75-6077d9daa7eb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:03:13 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-a95f5f62-e971-4303-a11b-3e47d1b5b57c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:03:13 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-a95f5f62-e971-4303-a11b-3e47d1b5b57c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:03:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a95f5f62-e971-4303-a11b-3e47d1b5b57c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a95f5f62-e971-4303-a11b-3e47d1b5b57c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a95f5f62-e971-4303-a11b-3e47d1b5b57c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a95f5f62-e971-4303-a11b-3e47d1b5b57c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a95f5f62-e971-4303-a11b-3e47d1b5b57c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a95f5f62-e971-4303-a11b-3e47d1b5b57c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:13 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-a95f5f62-e971-4303-a11b-3e47d1b5b57c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] HTTP exception thrown: Instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 could not be found. Apr 14 19:03:13 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-a95f5f62-e971-4303-a11b-3e47d1b5b57c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Request method failure captured: Apr 14 19:03:13 user devstack@n-api.service[61675]: request: GET /compute/v2.1/servers/1feb4399-a5dc-43a7-ac78-4d22809e2737 HTTP/1.1 Apr 14 19:03:13 user devstack@n-api.service[61675]: Accept: application/json Apr 14 19:03:13 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 19:03:13 user devstack@n-api.service[61675]: Connection: close Apr 14 19:03:13 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 19:03:13 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 19:03:13 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 19:03:13 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 19:03:13 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 19:03:13 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOaGNnePEq1MpwMLxXNyF4LOeXDJn61FOEBZ2tU-sdoW52xSWoc9fdzInbjmjI0NsKBhFG_b4MIZUnz81qLIWMIWkCQqtat-0Oe54LrtV8g2-CLEh546LjB2jMSHj6ba6aDXVKxF0V_H5nlAqW2ihRNa1ZwT2u0E01W2xidj7i2PG2vs Apr 14 19:03:13 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 19:03:13 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 19:03:13 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 19:03:13 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 19:03:13 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 19:03:13 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 19:03:13 user devstack@n-api.service[61675]: X-Project-Id: 921435d84194431c886ec1ed1848d4d6 Apr 14 19:03:13 user devstack@n-api.service[61675]: X-Project-Name: tempest-TestStampPattern-251531447 Apr 14 19:03:13 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 19:03:13 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 19:03:13 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/921435d84194431c886ec1ed1848d4d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/921435d84194431c886ec1ed1848d4d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/921435d84194431c886ec1ed1848d4d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:03:13 user devstack@n-api.service[61675]: X-Tenant: tempest-TestStampPattern-251531447 Apr 14 19:03:13 user devstack@n-api.service[61675]: X-Tenant-Id: 921435d84194431c886ec1ed1848d4d6 Apr 14 19:03:13 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-TestStampPattern-251531447 Apr 14 19:03:13 user devstack@n-api.service[61675]: X-User: tempest-TestStampPattern-251531447-project-member Apr 14 19:03:13 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 19:03:13 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 19:03:13 user devstack@n-api.service[61675]: X-User-Id: 9a9414d0c24643fdb162aad828c736bd Apr 14 19:03:13 user devstack@n-api.service[61675]: X-User-Name: tempest-TestStampPattern-251531447-project-member Apr 14 19:03:13 user devstack@n-api.service[61675]: method: > Apr 14 19:03:13 user devstack@n-api.service[61675]: exception: Instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 could not be found. Apr 14 19:03:13 user devstack@n-api.service[61675]: action_args: {'id': '1feb4399-a5dc-43a7-ac78-4d22809e2737'} Apr 14 19:03:13 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 could not be found. Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 could not be found. Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 could not be found. Apr 14 19:03:13 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:03:13 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-a95f5f62-e971-4303-a11b-3e47d1b5b57c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Returning 404 to user: Instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:03:13 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-a95f5f62-e971-4303-a11b-3e47d1b5b57c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1feb4399-a5dc-43a7-ac78-4d22809e2737" status: 404 len: 111 microversion: 2.1 time: 0.030339 Apr 14 19:03:13 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 275/828] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:03:13 2023] GET /compute/v2.1/servers/1feb4399-a5dc-43a7-ac78-4d22809e2737 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:03:17 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-802c8ece-fa21-44ee-8bd6-2ea73ec7a7e8 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Calling method '.version_select at 0x7fdae1036680>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:03:17 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-802c8ece-fa21-44ee-8bd6-2ea73ec7a7e8 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-580300982" status: 202 len: 0 microversion: 2.1 time: 0.038441 Apr 14 19:03:17 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 274/829] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 19:03:17 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-580300982 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 19:03:24 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=4 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:03:24 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=4 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:03:24 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-6391e817-33dd-46c4-abc4-7c8b7f158895 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Action: 'create', calling method: .version_select at 0x7fdae11744c0>, body: {"keypair": {"name": "tempest-keypair-1365704596", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMie4jk+eKDDeaE+UlFjfMzkkdZn5tHrG2pp7P8c6d+PQZvYazMq2yTH5MI/VepSyomDJZZ/cTr9HacR1kMWge6kZ4qBZES1sp1DTJQpGt0DwmP8idMT1Qs9zoNJj5wRSQ=="}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:03:24 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-6391e817-33dd-46c4-abc4-7c8b7f158895 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Getting quotas for project ebb0956418bd462c84e1392a74b5ae2e. Resources: {'key_pairs'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 19:03:24 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-6391e817-33dd-46c4-abc4-7c8b7f158895 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Getting quotas for user 716e5499c6eb483e9c88fd25606018d9 and project ebb0956418bd462c84e1392a74b5ae2e. Resources: {'key_pairs'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 19:03:24 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-6391e817-33dd-46c4-abc4-7c8b7f158895 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.268505 Apr 14 19:03:24 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 281/830] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 19:03:24 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 270 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 19:03:25 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-f9ac3a8b-b6aa-4031-b42f-902c3dd9ca7e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:03:25 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-f9ac3a8b-b6aa-4031-b42f-902c3dd9ca7e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:03:25 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:03:25 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:03:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f9ac3a8b-b6aa-4031-b42f-902c3dd9ca7e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f9ac3a8b-b6aa-4031-b42f-902c3dd9ca7e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f9ac3a8b-b6aa-4031-b42f-902c3dd9ca7e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f9ac3a8b-b6aa-4031-b42f-902c3dd9ca7e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f9ac3a8b-b6aa-4031-b42f-902c3dd9ca7e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f9ac3a8b-b6aa-4031-b42f-902c3dd9ca7e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:25 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-f9ac3a8b-b6aa-4031-b42f-902c3dd9ca7e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] HTTP exception thrown: Instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 could not be found. Apr 14 19:03:25 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-f9ac3a8b-b6aa-4031-b42f-902c3dd9ca7e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Request method failure captured: Apr 14 19:03:25 user devstack@n-api.service[61675]: request: GET /compute/v2.1/servers/698bc2dc-aff4-4148-b80e-8b77c846faf7 HTTP/1.1 Apr 14 19:03:25 user devstack@n-api.service[61675]: Accept: application/json Apr 14 19:03:25 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 19:03:25 user devstack@n-api.service[61675]: Connection: close Apr 14 19:03:25 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 19:03:25 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 19:03:25 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 19:03:25 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 19:03:25 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 19:03:25 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOaGjzEHP4gR4MoApqz0vJpRX2_SvaMHlWJEk_fU7mYw99OWl-qUsSQ6rEQ6kqDrRwocqp34lWfQib95-KwgiyuwPlyVpsmwfmwLReClbkEHff7utOAgEbSdfwWoPS9VLZQQ0SJcp_M6aCZY6cryOh5BrJ2VueTzigMFoaeOsa0D5fWA Apr 14 19:03:25 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 19:03:25 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 19:03:25 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 19:03:25 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 19:03:25 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 19:03:25 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 19:03:25 user devstack@n-api.service[61675]: X-Project-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 19:03:25 user devstack@n-api.service[61675]: X-Project-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:03:25 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 19:03:25 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 19:03:25 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:03:25 user devstack@n-api.service[61675]: X-Tenant: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:03:25 user devstack@n-api.service[61675]: X-Tenant-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 19:03:25 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:03:25 user devstack@n-api.service[61675]: X-User: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 19:03:25 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 19:03:25 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 19:03:25 user devstack@n-api.service[61675]: X-User-Id: fc3bed70703a49c8bdec2f50193c7f70 Apr 14 19:03:25 user devstack@n-api.service[61675]: X-User-Name: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 19:03:25 user devstack@n-api.service[61675]: method: > Apr 14 19:03:25 user devstack@n-api.service[61675]: exception: Instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 could not be found. Apr 14 19:03:25 user devstack@n-api.service[61675]: action_args: {'id': '698bc2dc-aff4-4148-b80e-8b77c846faf7'} Apr 14 19:03:25 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 could not be found. Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 could not be found. Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 could not be found. Apr 14 19:03:25 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:03:25 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-f9ac3a8b-b6aa-4031-b42f-902c3dd9ca7e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Returning 404 to user: Instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:03:25 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-f9ac3a8b-b6aa-4031-b42f-902c3dd9ca7e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/698bc2dc-aff4-4148-b80e-8b77c846faf7" status: 404 len: 111 microversion: 2.1 time: 0.044990 Apr 14 19:03:25 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 276/831] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:03:25 2023] GET /compute/v2.1/servers/698bc2dc-aff4-4148-b80e-8b77c846faf7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:03:26 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1127447025", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "398116e9-945d-474d-918d-f2f5ac726032"}], "security_groups": [{"name": "tempest-securitygroup--1359887951"}], "key_name": "tempest-keypair-1365704596", "user_data": "}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:03:26 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=8 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:03:26 user devstack@n-api.service[61673]: DEBUG nova.network.neutron [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] validate_networks() for [('398116e9-945d-474d-918d-f2f5ac726032', None, None, None, None, None)] {{(pid=61673) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 19:03:27 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Flavor limits 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 19:03:27 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Image limits 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 19:03:27 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Flavor pref 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 19:03:27 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Image pref 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 19:03:27 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 19:03:27 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:27 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:27 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:27 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:27 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:27 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:27 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Getting quotas for project ebb0956418bd462c84e1392a74b5ae2e. Resources: {'ram', 'instances', 'cores'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 19:03:27 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Getting quotas for user 716e5499c6eb483e9c88fd25606018d9 and project ebb0956418bd462c84e1392a74b5ae2e. Resources: {'ram', 'instances', 'cores'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 19:03:27 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Going to run 1 instances... {{(pid=61673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 19:03:27 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 19:03:27 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.672367 Apr 14 19:03:27 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 275/832] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 19:03:26 2023] POST /compute/v2.1/servers => generated 400 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 19:03:27 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-cc8eae01-4e74-48df-905e-e3f6c7cc8943 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:03:27 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-cc8eae01-4e74-48df-905e-e3f6c7cc8943 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:03:27 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-cc8eae01-4e74-48df-905e-e3f6c7cc8943 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:03:27 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-cc8eae01-4e74-48df-905e-e3f6c7cc8943 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:03:27 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-cc8eae01-4e74-48df-905e-e3f6c7cc8943 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:03:27 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-cc8eae01-4e74-48df-905e-e3f6c7cc8943 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a" status: 200 len: 1276 microversion: 2.20 time: 0.078644 Apr 14 19:03:27 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 282/833] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:03:27 2023] GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a => generated 1276 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 19:03:28 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:03:28 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:03:28 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:28 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:28 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:28 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:28 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:28 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:28 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Going to try to terminate instance {{(pid=61675) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 19:03:28 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/56097076-1e63-41ba-8331-be8ede06c537" status: 204 len: 0 microversion: 2.1 time: 0.127735 Apr 14 19:03:28 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 277/834] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:03:28 2023] DELETE /compute/v2.1/servers/56097076-1e63-41ba-8331-be8ede06c537 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 19:03:28 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-c7427a51-110d-49ee-8642-9a654f8e46ae tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:03:28 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-c7427a51-110d-49ee-8642-9a654f8e46ae tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:03:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c7427a51-110d-49ee-8642-9a654f8e46ae tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c7427a51-110d-49ee-8642-9a654f8e46ae tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c7427a51-110d-49ee-8642-9a654f8e46ae tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c7427a51-110d-49ee-8642-9a654f8e46ae tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c7427a51-110d-49ee-8642-9a654f8e46ae tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c7427a51-110d-49ee-8642-9a654f8e46ae tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:29 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-c7427a51-110d-49ee-8642-9a654f8e46ae tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:03:29 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-c7427a51-110d-49ee-8642-9a654f8e46ae tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56097076-1e63-41ba-8331-be8ede06c537" status: 200 len: 1397 microversion: 2.1 time: 0.262419 Apr 14 19:03:29 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 276/835] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:03:28 2023] GET /compute/v2.1/servers/56097076-1e63-41ba-8331-be8ede06c537 => generated 1397 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:03:29 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-5be60de9-7e70-410c-a5d1-5462296c4f34 req-cb520343-a5a8-4021-8a77-c8209d34e66b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56097076-1e63-41ba-8331-be8ede06c537", "name": "network-vif-unplugged", "status": "completed", "tag": "f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:03:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-5be60de9-7e70-410c-a5d1-5462296c4f34 req-cb520343-a5a8-4021-8a77-c8209d34e66b service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-5be60de9-7e70-410c-a5d1-5462296c4f34 req-cb520343-a5a8-4021-8a77-c8209d34e66b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-5be60de9-7e70-410c-a5d1-5462296c4f34 req-cb520343-a5a8-4021-8a77-c8209d34e66b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:29 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-5be60de9-7e70-410c-a5d1-5462296c4f34 req-cb520343-a5a8-4021-8a77-c8209d34e66b service nova] Creating event network-vif-unplugged:f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a for instance 56097076-1e63-41ba-8331-be8ede06c537 on user Apr 14 19:03:29 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-5be60de9-7e70-410c-a5d1-5462296c4f34 req-cb520343-a5a8-4021-8a77-c8209d34e66b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060962 Apr 14 19:03:29 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 283/836] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:03:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:03:31 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-c0dd8663-8c81-40ef-befd-2c226dfe2dc2 req-60f76e07-5e01-43b1-9006-3c2e6a6d35dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56097076-1e63-41ba-8331-be8ede06c537", "name": "network-vif-plugged", "status": "completed", "tag": "f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:03:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-c0dd8663-8c81-40ef-befd-2c226dfe2dc2 req-60f76e07-5e01-43b1-9006-3c2e6a6d35dc service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-c0dd8663-8c81-40ef-befd-2c226dfe2dc2 req-60f76e07-5e01-43b1-9006-3c2e6a6d35dc service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-c0dd8663-8c81-40ef-befd-2c226dfe2dc2 req-60f76e07-5e01-43b1-9006-3c2e6a6d35dc service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:31 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-c0dd8663-8c81-40ef-befd-2c226dfe2dc2 req-60f76e07-5e01-43b1-9006-3c2e6a6d35dc service nova] Creating event network-vif-plugged:f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a for instance 56097076-1e63-41ba-8331-be8ede06c537 on user Apr 14 19:03:31 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-c0dd8663-8c81-40ef-befd-2c226dfe2dc2 req-60f76e07-5e01-43b1-9006-3c2e6a6d35dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029294 Apr 14 19:03:31 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 278/837] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:03:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:03:31 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-1d41d8bb-51ad-43b6-8c52-c5dd0c3a1249 req-6986d14c-e0fd-4e9a-bd6d-2fc23a3c1469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56097076-1e63-41ba-8331-be8ede06c537", "name": "network-vif-deleted", "tag": "f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:03:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-1d41d8bb-51ad-43b6-8c52-c5dd0c3a1249 req-6986d14c-e0fd-4e9a-bd6d-2fc23a3c1469 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-1d41d8bb-51ad-43b6-8c52-c5dd0c3a1249 req-6986d14c-e0fd-4e9a-bd6d-2fc23a3c1469 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:31 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-1d41d8bb-51ad-43b6-8c52-c5dd0c3a1249 req-6986d14c-e0fd-4e9a-bd6d-2fc23a3c1469 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:31 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-1d41d8bb-51ad-43b6-8c52-c5dd0c3a1249 req-6986d14c-e0fd-4e9a-bd6d-2fc23a3c1469 service nova] Creating event network-vif-deleted:f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a for instance 56097076-1e63-41ba-8331-be8ede06c537 on user Apr 14 19:03:31 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-1d41d8bb-51ad-43b6-8c52-c5dd0c3a1249 req-6986d14c-e0fd-4e9a-bd6d-2fc23a3c1469 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030086 Apr 14 19:03:31 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 277/838] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:03:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:03:33 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-a45e3476-27c1-42a1-ac55-cdf88530271e req-5fcff51e-2866-4234-856b-675260fbd8a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "179270ef-7866-4ee7-af13-ec3ea5e7525a", "tag": "fef01e15-9070-4b0b-ba18-0b9540774cb9"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:03:33 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-a45e3476-27c1-42a1-ac55-cdf88530271e req-5fcff51e-2866-4234-856b-675260fbd8a9 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:33 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-a45e3476-27c1-42a1-ac55-cdf88530271e req-5fcff51e-2866-4234-856b-675260fbd8a9 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:33 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-a45e3476-27c1-42a1-ac55-cdf88530271e req-5fcff51e-2866-4234-856b-675260fbd8a9 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:33 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-a45e3476-27c1-42a1-ac55-cdf88530271e req-5fcff51e-2866-4234-856b-675260fbd8a9 service nova] Creating event network-changed:fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance 179270ef-7866-4ee7-af13-ec3ea5e7525a on user Apr 14 19:03:33 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-a45e3476-27c1-42a1-ac55-cdf88530271e req-5fcff51e-2866-4234-856b-675260fbd8a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040818 Apr 14 19:03:33 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 284/839] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:03:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 19:03:35 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-cf081496-09cd-404f-975f-e9004c5c3fa8 req-968e9607-4f60-41dd-98de-a945095645d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179270ef-7866-4ee7-af13-ec3ea5e7525a", "name": "network-vif-plugged", "status": "completed", "tag": "fef01e15-9070-4b0b-ba18-0b9540774cb9"}, {"server_uuid": "179270ef-7866-4ee7-af13-ec3ea5e7525a", "name": "network-vif-plugged", "status": "completed", "tag": "fef01e15-9070-4b0b-ba18-0b9540774cb9"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:03:35 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-cf081496-09cd-404f-975f-e9004c5c3fa8 req-968e9607-4f60-41dd-98de-a945095645d6 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:35 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-cf081496-09cd-404f-975f-e9004c5c3fa8 req-968e9607-4f60-41dd-98de-a945095645d6 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:35 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-cf081496-09cd-404f-975f-e9004c5c3fa8 req-968e9607-4f60-41dd-98de-a945095645d6 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:35 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-cf081496-09cd-404f-975f-e9004c5c3fa8 req-968e9607-4f60-41dd-98de-a945095645d6 service nova] Creating event network-vif-plugged:fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance 179270ef-7866-4ee7-af13-ec3ea5e7525a on user Apr 14 19:03:35 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-cf081496-09cd-404f-975f-e9004c5c3fa8 req-968e9607-4f60-41dd-98de-a945095645d6 service nova] Creating event network-vif-plugged:fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance 179270ef-7866-4ee7-af13-ec3ea5e7525a on user Apr 14 19:03:35 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-cf081496-09cd-404f-975f-e9004c5c3fa8 req-968e9607-4f60-41dd-98de-a945095645d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051630 Apr 14 19:03:35 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 279/840] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:03:35 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:03:39 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:03:39 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=6 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:03:39 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-3cbd14cd-2650-41d1-af9c-97b262b19d4d tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:03:39 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-3cbd14cd-2650-41d1-af9c-97b262b19d4d tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:03:39 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:03:39 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-3cbd14cd-2650-41d1-af9c-97b262b19d4d tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:39 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-3cbd14cd-2650-41d1-af9c-97b262b19d4d tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:39 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-3cbd14cd-2650-41d1-af9c-97b262b19d4d tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:39 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-3cbd14cd-2650-41d1-af9c-97b262b19d4d tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:39 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-3cbd14cd-2650-41d1-af9c-97b262b19d4d tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:39 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-3cbd14cd-2650-41d1-af9c-97b262b19d4d tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:39 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-3cbd14cd-2650-41d1-af9c-97b262b19d4d tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.184793 Apr 14 19:03:39 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 278/841] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 19:03:39 2023] GET /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468/os-interface => generated 283 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:03:41 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-50f002df-69d6-4c2c-a4bd-6eb14a22c081 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:03:41 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-50f002df-69d6-4c2c-a4bd-6eb14a22c081 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:03:41 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=6 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:03:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-50f002df-69d6-4c2c-a4bd-6eb14a22c081 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-50f002df-69d6-4c2c-a4bd-6eb14a22c081 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-50f002df-69d6-4c2c-a4bd-6eb14a22c081 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-50f002df-69d6-4c2c-a4bd-6eb14a22c081 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-50f002df-69d6-4c2c-a4bd-6eb14a22c081 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-50f002df-69d6-4c2c-a4bd-6eb14a22c081 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-8dfbfa37-f048-44df-b2a2-e65e8734f7ff req-de349b7e-6c08-4681-8edb-798ed42b44e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46d51513-1995-43c5-976a-40789ae575f1", "tag": "48f196d4-dd0c-4499-8b7b-b0c4199cc059"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-8dfbfa37-f048-44df-b2a2-e65e8734f7ff req-de349b7e-6c08-4681-8edb-798ed42b44e9 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-8dfbfa37-f048-44df-b2a2-e65e8734f7ff req-de349b7e-6c08-4681-8edb-798ed42b44e9 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-8dfbfa37-f048-44df-b2a2-e65e8734f7ff req-de349b7e-6c08-4681-8edb-798ed42b44e9 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:41 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-54e42bc9-2e3e-44d0-b8c3-5721da313c5b tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:03:41 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-8dfbfa37-f048-44df-b2a2-e65e8734f7ff req-de349b7e-6c08-4681-8edb-798ed42b44e9 service nova] Creating event network-changed:48f196d4-dd0c-4499-8b7b-b0c4199cc059 for instance 46d51513-1995-43c5-976a-40789ae575f1 on user Apr 14 19:03:41 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-54e42bc9-2e3e-44d0-b8c3-5721da313c5b tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:03:41 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-8dfbfa37-f048-44df-b2a2-e65e8734f7ff req-de349b7e-6c08-4681-8edb-798ed42b44e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053359 Apr 14 19:03:41 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 280/842] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:03:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:03:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-54e42bc9-2e3e-44d0-b8c3-5721da313c5b tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-54e42bc9-2e3e-44d0-b8c3-5721da313c5b tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-54e42bc9-2e3e-44d0-b8c3-5721da313c5b tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-54e42bc9-2e3e-44d0-b8c3-5721da313c5b tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-54e42bc9-2e3e-44d0-b8c3-5721da313c5b tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-54e42bc9-2e3e-44d0-b8c3-5721da313c5b tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:41 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-54e42bc9-2e3e-44d0-b8c3-5721da313c5b tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:03:41 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-54e42bc9-2e3e-44d0-b8c3-5721da313c5b tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468" status: 200 len: 1429 microversion: 2.1 time: 0.270221 Apr 14 19:03:41 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 279/843] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:03:41 2023] GET /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468 => generated 1429 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Old instance type m1.nano, new instance type m1.micro {{(pid=61675) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting quotas for project f028a79640b848228dc6e654a0eef49b. Resources: {'ram', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting quotas for user 55fa4abe2fdd48cb91f39bf8156a7793 and project f028a79640b848228dc6e654a0eef49b. Resources: {'ram', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flavor limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Image limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flavor pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Image pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 19:03:41 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 19:03:42 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468/action" status: 202 len: 0 microversion: 2.1 time: 0.245286 Apr 14 19:03:42 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 281/844] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 19:03:41 2023] POST /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 19:03:42 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-fe8eacf1-86e6-4c2e-bc5c-53b9005bbd32 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:03:42 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-fe8eacf1-86e6-4c2e-bc5c-53b9005bbd32 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:03:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-fe8eacf1-86e6-4c2e-bc5c-53b9005bbd32 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-fe8eacf1-86e6-4c2e-bc5c-53b9005bbd32 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-fe8eacf1-86e6-4c2e-bc5c-53b9005bbd32 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-fe8eacf1-86e6-4c2e-bc5c-53b9005bbd32 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-fe8eacf1-86e6-4c2e-bc5c-53b9005bbd32 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-fe8eacf1-86e6-4c2e-bc5c-53b9005bbd32 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:42 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-50f002df-69d6-4c2c-a4bd-6eb14a22c081 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8713ed85ffb4446847f5ded4bc2e399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60e8abd123e414f847c68ba72894689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:03:42 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-50f002df-69d6-4c2c-a4bd-6eb14a22c081 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58" status: 200 len: 1716 microversion: 2.1 time: 0.929665 Apr 14 19:03:42 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 285/845] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:03:41 2023] GET /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58 => generated 1716 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:03:42 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-fe8eacf1-86e6-4c2e-bc5c-53b9005bbd32 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:03:42 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-fe8eacf1-86e6-4c2e-bc5c-53b9005bbd32 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468" status: 200 len: 1438 microversion: 2.1 time: 0.257061 Apr 14 19:03:42 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 280/846] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:03:42 2023] GET /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468 => generated 1438 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:03:43 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-dd973b10-50d1-4808-a6d6-53f96143557f tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Action: 'create', calling method: .version_select at 0x7fdae1157640>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1211605812", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrqSX4Dn4cbtD2ThR27vz4fxPv5iy/c0ZdVOmEv91SBknzw38dyQkj7dyYpk0+xiBPENn2s6fqiXGS4lq+2CMLc45iU3VwfBmaBTRKP0e+5nHYYYSr3CL2L7A6SUZfiQg=="}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:03:43 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-dd973b10-50d1-4808-a6d6-53f96143557f tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Getting quotas for project 81575e6ed9bc41d2ad2ac1ad0fbd253d. Resources: {'key_pairs'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 19:03:43 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-dd973b10-50d1-4808-a6d6-53f96143557f tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Getting quotas for user 10cf3683f78d4724bb734e5280e8736b and project 81575e6ed9bc41d2ad2ac1ad0fbd253d. Resources: {'key_pairs'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 19:03:43 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-dd973b10-50d1-4808-a6d6-53f96143557f tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.202187 Apr 14 19:03:43 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 282/847] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 19:03:42 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:03:43 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-51e256a4-9d41-4701-b492-2dbe30157f33 req-90ddeeb8-2885-4a9f-844f-4240224f71eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4a54fb1-bd66-42f5-9f8c-9fb40470f468", "tag": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:03:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-51e256a4-9d41-4701-b492-2dbe30157f33 req-90ddeeb8-2885-4a9f-844f-4240224f71eb service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-51e256a4-9d41-4701-b492-2dbe30157f33 req-90ddeeb8-2885-4a9f-844f-4240224f71eb service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-51e256a4-9d41-4701-b492-2dbe30157f33 req-90ddeeb8-2885-4a9f-844f-4240224f71eb service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:43 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-51e256a4-9d41-4701-b492-2dbe30157f33 req-90ddeeb8-2885-4a9f-844f-4240224f71eb service nova] Creating event network-changed:bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 for instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 on user Apr 14 19:03:43 user devstack@n-api.service[61674]: DEBUG nova.compute.api [req-51e256a4-9d41-4701-b492-2dbe30157f33 req-90ddeeb8-2885-4a9f-844f-4240224f71eb service nova] Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61674) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 19:03:43 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-51e256a4-9d41-4701-b492-2dbe30157f33 req-90ddeeb8-2885-4a9f-844f-4240224f71eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042656 Apr 14 19:03:43 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 286/848] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:03:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:03:44 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1761427350", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1211605812", "security_groups": [{"name": "tempest-secgroup-smoke-1627869983"}], "networks": [{"uuid": "912a39a0-80e1-492a-a05a-8523964167a0"}]}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:03:44 user devstack@n-api.service[61673]: DEBUG nova.network.neutron [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] validate_networks() for [('912a39a0-80e1-492a-a05a-8523964167a0', None, None, None, None, None)] {{(pid=61673) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 19:03:45 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Flavor limits 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 19:03:45 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Image limits 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 19:03:45 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Flavor pref 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 19:03:45 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Image pref 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 19:03:45 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 19:03:45 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:45 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:45 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:45 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:45 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:45 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:45 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Getting quotas for project 81575e6ed9bc41d2ad2ac1ad0fbd253d. Resources: {'ram', 'instances', 'cores'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 19:03:45 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Getting quotas for user 10cf3683f78d4724bb734e5280e8736b and project 81575e6ed9bc41d2ad2ac1ad0fbd253d. Resources: {'ram', 'instances', 'cores'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 19:03:45 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Going to run 1 instances... {{(pid=61673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 19:03:45 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 19:03:45 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.804396 Apr 14 19:03:45 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 281/849] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 19:03:44 2023] POST /compute/v2.1/servers => generated 404 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 19:03:45 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-980aefae-74d2-45d2-b419-562ced52337f tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:03:45 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-980aefae-74d2-45d2-b419-562ced52337f tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:03:45 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-980aefae-74d2-45d2-b419-562ced52337f tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10cf3683f78d4724bb734e5280e8736b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81575e6ed9bc41d2ad2ac1ad0fbd253d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:03:45 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-980aefae-74d2-45d2-b419-562ced52337f tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be" status: 200 len: 1257 microversion: 2.1 time: 0.060818 Apr 14 19:03:45 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 283/850] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:03:45 2023] GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be => generated 1257 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:03:45 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-7c3af91d-bfc9-4912-b845-68b7ee5425e3 req-db0666db-88e8-4b0a-9806-36acab52a3f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4a54fb1-bd66-42f5-9f8c-9fb40470f468", "name": "network-vif-unplugged", "status": "completed", "tag": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:03:45 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-7c3af91d-bfc9-4912-b845-68b7ee5425e3 req-db0666db-88e8-4b0a-9806-36acab52a3f5 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:45 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-7c3af91d-bfc9-4912-b845-68b7ee5425e3 req-db0666db-88e8-4b0a-9806-36acab52a3f5 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:45 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-7c3af91d-bfc9-4912-b845-68b7ee5425e3 req-db0666db-88e8-4b0a-9806-36acab52a3f5 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:45 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-7c3af91d-bfc9-4912-b845-68b7ee5425e3 req-db0666db-88e8-4b0a-9806-36acab52a3f5 service nova] Creating event network-vif-unplugged:bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 for instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 on user Apr 14 19:03:45 user devstack@n-api.service[61674]: DEBUG nova.compute.api [req-7c3af91d-bfc9-4912-b845-68b7ee5425e3 req-db0666db-88e8-4b0a-9806-36acab52a3f5 service nova] Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61674) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 19:03:45 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-7c3af91d-bfc9-4912-b845-68b7ee5425e3 req-db0666db-88e8-4b0a-9806-36acab52a3f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044570 Apr 14 19:03:45 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 287/851] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:03:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:03:45 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-684da327-a347-498a-b802-353529ae1b07 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:03:45 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-684da327-a347-498a-b802-353529ae1b07 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:03:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-684da327-a347-498a-b802-353529ae1b07 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-684da327-a347-498a-b802-353529ae1b07 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-684da327-a347-498a-b802-353529ae1b07 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-684da327-a347-498a-b802-353529ae1b07 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-684da327-a347-498a-b802-353529ae1b07 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-684da327-a347-498a-b802-353529ae1b07 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:46 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-684da327-a347-498a-b802-353529ae1b07 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.183940 Apr 14 19:03:46 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 282/852] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 19:03:45 2023] GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f/os-interface => generated 282 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:03:47 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-a92ac941-fffc-4076-940c-fd1bc0f58973 req-d8e35843-03ea-42f1-8cd1-69fe51613aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15ebad56-cad0-4ab3-853f-72e3a3d2117f", "tag": "08acb0d5-2432-42fe-a372-78f11a73ed56"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:03:47 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-a92ac941-fffc-4076-940c-fd1bc0f58973 req-d8e35843-03ea-42f1-8cd1-69fe51613aa6 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:47 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-a92ac941-fffc-4076-940c-fd1bc0f58973 req-d8e35843-03ea-42f1-8cd1-69fe51613aa6 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:47 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-a92ac941-fffc-4076-940c-fd1bc0f58973 req-d8e35843-03ea-42f1-8cd1-69fe51613aa6 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:47 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-a92ac941-fffc-4076-940c-fd1bc0f58973 req-d8e35843-03ea-42f1-8cd1-69fe51613aa6 service nova] Creating event network-changed:08acb0d5-2432-42fe-a372-78f11a73ed56 for instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f on user Apr 14 19:03:47 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-a92ac941-fffc-4076-940c-fd1bc0f58973 req-d8e35843-03ea-42f1-8cd1-69fe51613aa6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030591 Apr 14 19:03:47 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 284/853] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:03:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:03:47 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-33c5d101-2f21-4158-8226-762df6b59272 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:03:47 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-33c5d101-2f21-4158-8226-762df6b59272 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:03:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-33c5d101-2f21-4158-8226-762df6b59272 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-33c5d101-2f21-4158-8226-762df6b59272 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-33c5d101-2f21-4158-8226-762df6b59272 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-33c5d101-2f21-4158-8226-762df6b59272 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-33c5d101-2f21-4158-8226-762df6b59272 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-33c5d101-2f21-4158-8226-762df6b59272 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:47 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-33c5d101-2f21-4158-8226-762df6b59272 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f/ips" status: 200 len: 104 microversion: 2.1 time: 0.038420 Apr 14 19:03:47 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 288/854] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 19:03:47 2023] GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f/ips => generated 104 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:03:47 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-c4decb14-8aa5-4620-8532-0ce2f1d58772 req-50ae4344-f12c-427a-bab8-9ab96c59b3ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4a54fb1-bd66-42f5-9f8c-9fb40470f468", "name": "network-vif-plugged", "status": "completed", "tag": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:03:47 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-c4decb14-8aa5-4620-8532-0ce2f1d58772 req-50ae4344-f12c-427a-bab8-9ab96c59b3ba service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:47 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-c4decb14-8aa5-4620-8532-0ce2f1d58772 req-50ae4344-f12c-427a-bab8-9ab96c59b3ba service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:47 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-c4decb14-8aa5-4620-8532-0ce2f1d58772 req-50ae4344-f12c-427a-bab8-9ab96c59b3ba service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:48 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-c4decb14-8aa5-4620-8532-0ce2f1d58772 req-50ae4344-f12c-427a-bab8-9ab96c59b3ba service nova] Creating event network-vif-plugged:bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 for instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 on user Apr 14 19:03:48 user devstack@n-api.service[61673]: DEBUG nova.compute.api [req-c4decb14-8aa5-4620-8532-0ce2f1d58772 req-50ae4344-f12c-427a-bab8-9ab96c59b3ba service nova] Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61673) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 19:03:48 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-c4decb14-8aa5-4620-8532-0ce2f1d58772 req-50ae4344-f12c-427a-bab8-9ab96c59b3ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046969 Apr 14 19:03:48 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 283/855] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:03:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:03:49 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-13103b23-e4ca-4ade-b5b9-964f241af341 req-55f3a5fa-bb74-4fe0-8387-49fdac0a4646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9379580-fd2f-4468-9ed3-7109735195be", "tag": "f22a5e1e-5aed-419f-aa06-308984681fbc"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:03:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-13103b23-e4ca-4ade-b5b9-964f241af341 req-55f3a5fa-bb74-4fe0-8387-49fdac0a4646 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-13103b23-e4ca-4ade-b5b9-964f241af341 req-55f3a5fa-bb74-4fe0-8387-49fdac0a4646 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-13103b23-e4ca-4ade-b5b9-964f241af341 req-55f3a5fa-bb74-4fe0-8387-49fdac0a4646 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:49 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-13103b23-e4ca-4ade-b5b9-964f241af341 req-55f3a5fa-bb74-4fe0-8387-49fdac0a4646 service nova] Creating event network-changed:f22a5e1e-5aed-419f-aa06-308984681fbc for instance a9379580-fd2f-4468-9ed3-7109735195be on user Apr 14 19:03:49 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-13103b23-e4ca-4ade-b5b9-964f241af341 req-55f3a5fa-bb74-4fe0-8387-49fdac0a4646 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037158 Apr 14 19:03:49 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 285/856] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:03:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:03:50 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "afa35698-f508-4611-b895-bc408a4fb317"}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:03:50 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:03:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:50 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "POST /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326360 Apr 14 19:03:50 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 289/857] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 19:03:50 2023] POST /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:03:51 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-e495d845-d8a4-4602-b393-39566bb9f6ca req-ad5abe5e-f8b5-4ff1-9dc7-cc3bbd67bccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9379580-fd2f-4468-9ed3-7109735195be", "name": "network-vif-plugged", "status": "completed", "tag": "f22a5e1e-5aed-419f-aa06-308984681fbc"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:03:51 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-e495d845-d8a4-4602-b393-39566bb9f6ca req-ad5abe5e-f8b5-4ff1-9dc7-cc3bbd67bccf service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:51 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-e495d845-d8a4-4602-b393-39566bb9f6ca req-ad5abe5e-f8b5-4ff1-9dc7-cc3bbd67bccf service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:51 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-e495d845-d8a4-4602-b393-39566bb9f6ca req-ad5abe5e-f8b5-4ff1-9dc7-cc3bbd67bccf service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:51 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-e495d845-d8a4-4602-b393-39566bb9f6ca req-ad5abe5e-f8b5-4ff1-9dc7-cc3bbd67bccf service nova] Creating event network-vif-plugged:f22a5e1e-5aed-419f-aa06-308984681fbc for instance a9379580-fd2f-4468-9ed3-7109735195be on user Apr 14 19:03:51 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-e495d845-d8a4-4602-b393-39566bb9f6ca req-ad5abe5e-f8b5-4ff1-9dc7-cc3bbd67bccf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049307 Apr 14 19:03:51 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 284/858] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:03:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:03:53 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=3 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:03:53 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-b1f2fa14-d4ca-4087-8c0a-7542a20f60ae req-ad200284-af0b-45b9-8d19-464e83648db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9379580-fd2f-4468-9ed3-7109735195be", "name": "network-vif-plugged", "status": "completed", "tag": "f22a5e1e-5aed-419f-aa06-308984681fbc"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:03:53 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-b1f2fa14-d4ca-4087-8c0a-7542a20f60ae req-ad200284-af0b-45b9-8d19-464e83648db5 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:53 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-b1f2fa14-d4ca-4087-8c0a-7542a20f60ae req-ad200284-af0b-45b9-8d19-464e83648db5 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:53 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-b1f2fa14-d4ca-4087-8c0a-7542a20f60ae req-ad200284-af0b-45b9-8d19-464e83648db5 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:53 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-b1f2fa14-d4ca-4087-8c0a-7542a20f60ae req-ad200284-af0b-45b9-8d19-464e83648db5 service nova] Creating event network-vif-plugged:f22a5e1e-5aed-419f-aa06-308984681fbc for instance a9379580-fd2f-4468-9ed3-7109735195be on user Apr 14 19:03:53 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-b1f2fa14-d4ca-4087-8c0a-7542a20f60ae req-ad200284-af0b-45b9-8d19-464e83648db5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037733 Apr 14 19:03:53 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 286/859] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:03:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:03:57 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-94237bf8-2c83-4b0f-b7a2-2c27d77c7f8a req-dbf77f01-0862-4d91-a7c2-d79aa46a10a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4a54fb1-bd66-42f5-9f8c-9fb40470f468", "name": "network-vif-plugged", "status": "completed", "tag": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:03:57 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:03:57 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-94237bf8-2c83-4b0f-b7a2-2c27d77c7f8a req-dbf77f01-0862-4d91-a7c2-d79aa46a10a4 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:57 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-94237bf8-2c83-4b0f-b7a2-2c27d77c7f8a req-dbf77f01-0862-4d91-a7c2-d79aa46a10a4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:57 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-94237bf8-2c83-4b0f-b7a2-2c27d77c7f8a req-dbf77f01-0862-4d91-a7c2-d79aa46a10a4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:57 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:03:57 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-94237bf8-2c83-4b0f-b7a2-2c27d77c7f8a req-dbf77f01-0862-4d91-a7c2-d79aa46a10a4 service nova] Creating event network-vif-plugged:bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 for instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 on user Apr 14 19:03:57 user devstack@n-api.service[61674]: DEBUG nova.compute.api [req-94237bf8-2c83-4b0f-b7a2-2c27d77c7f8a req-dbf77f01-0862-4d91-a7c2-d79aa46a10a4 service nova] Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61674) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 19:03:57 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-94237bf8-2c83-4b0f-b7a2-2c27d77c7f8a req-dbf77f01-0862-4d91-a7c2-d79aa46a10a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056356 Apr 14 19:03:57 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 290/860] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:03:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:03:58 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:03:58 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=6 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:03:58 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-3dcc5d31-ffb2-4bb9-9744-d1b0c9efe055 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:03:58 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-3dcc5d31-ffb2-4bb9-9744-d1b0c9efe055 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:03:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-3dcc5d31-ffb2-4bb9-9744-d1b0c9efe055 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-3dcc5d31-ffb2-4bb9-9744-d1b0c9efe055 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-3dcc5d31-ffb2-4bb9-9744-d1b0c9efe055 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-3dcc5d31-ffb2-4bb9-9744-d1b0c9efe055 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-3dcc5d31-ffb2-4bb9-9744-d1b0c9efe055 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-3dcc5d31-ffb2-4bb9-9744-d1b0c9efe055 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:58 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=39 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:03:58 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-3dcc5d31-ffb2-4bb9-9744-d1b0c9efe055 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054479 Apr 14 19:03:58 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 285/861] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 19:03:58 2023] GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:03:58 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=6 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:03:58 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-13b314f7-7f7f-4a96-b5bc-be49001f2d2d tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:03:58 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-13b314f7-7f7f-4a96-b5bc-be49001f2d2d tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:03:58 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:03:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-13b314f7-7f7f-4a96-b5bc-be49001f2d2d tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-13b314f7-7f7f-4a96-b5bc-be49001f2d2d tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-13b314f7-7f7f-4a96-b5bc-be49001f2d2d tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-13b314f7-7f7f-4a96-b5bc-be49001f2d2d tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-13b314f7-7f7f-4a96-b5bc-be49001f2d2d tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-13b314f7-7f7f-4a96-b5bc-be49001f2d2d tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:58 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:03:58 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-13b314f7-7f7f-4a96-b5bc-be49001f2d2d tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f/os-volume_attachments/afa35698-f508-4611-b895-bc408a4fb317" status: 200 len: 194 microversion: 2.1 time: 0.048891 Apr 14 19:03:58 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 287/862] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 19:03:58 2023] GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f/os-volume_attachments/afa35698-f508-4611-b895-bc408a4fb317 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:03:58 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-4b913743-a135-4ad6-a7d8-d4a9bf6e61fa tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:03:58 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-4b913743-a135-4ad6-a7d8-d4a9bf6e61fa tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:03:58 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4b913743-a135-4ad6-a7d8-d4a9bf6e61fa tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:58 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4b913743-a135-4ad6-a7d8-d4a9bf6e61fa tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:58 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4b913743-a135-4ad6-a7d8-d4a9bf6e61fa tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:58 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4b913743-a135-4ad6-a7d8-d4a9bf6e61fa tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:58 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4b913743-a135-4ad6-a7d8-d4a9bf6e61fa tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:58 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4b913743-a135-4ad6-a7d8-d4a9bf6e61fa tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:58 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-4b913743-a135-4ad6-a7d8-d4a9bf6e61fa tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] HTTP exception thrown: Instance 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 could not be found. Apr 14 19:03:58 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-4b913743-a135-4ad6-a7d8-d4a9bf6e61fa tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Request method failure captured: Apr 14 19:03:58 user devstack@n-api.service[61674]: request: GET /compute/v2.1/servers/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 HTTP/1.1 Apr 14 19:03:58 user devstack@n-api.service[61674]: Accept: application/json Apr 14 19:03:58 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 19:03:58 user devstack@n-api.service[61674]: Connection: close Apr 14 19:03:58 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 19:03:58 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 19:03:58 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 19:03:58 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 19:03:58 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 19:03:58 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOZ9nnPCXT2QdXSPWwVlCjp7pyXFpgrlAX-vfX50Qxai2B6k6Sv9Eh_PLls3HRJrj-Jv-x2WsQVnktQmvPcAus0yc32hEM2J2lZCmpZH6vf8f7he9r8FkKysH7AamOkQjdnbmnS_op_MrAg4cU3dqmaIghoDPfOx6PuY0hLvr2DGIzJg Apr 14 19:03:58 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 19:03:58 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 19:03:58 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 19:03:58 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 19:03:58 user devstack@n-api.service[61674]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 19:03:58 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 19:03:58 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 19:03:58 user devstack@n-api.service[61674]: X-Project-Id: 424e732759884efa8fd126cd9a082c8a Apr 14 19:03:58 user devstack@n-api.service[61674]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1815450365 Apr 14 19:03:58 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 19:03:58 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 19:03:58 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/424e732759884efa8fd126cd9a082c8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/424e732759884efa8fd126cd9a082c8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/424e732759884efa8fd126cd9a082c8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:03:58 user devstack@n-api.service[61674]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1815450365 Apr 14 19:03:58 user devstack@n-api.service[61674]: X-Tenant-Id: 424e732759884efa8fd126cd9a082c8a Apr 14 19:03:58 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1815450365 Apr 14 19:03:58 user devstack@n-api.service[61674]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member Apr 14 19:03:58 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 19:03:58 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 19:03:58 user devstack@n-api.service[61674]: X-User-Id: a644b8bb9b90494ba670da8315bfe005 Apr 14 19:03:58 user devstack@n-api.service[61674]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member Apr 14 19:03:58 user devstack@n-api.service[61674]: method: > Apr 14 19:03:58 user devstack@n-api.service[61674]: exception: Instance 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 could not be found. Apr 14 19:03:58 user devstack@n-api.service[61674]: action_args: {'id': '1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1'} Apr 14 19:03:58 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 could not be found. Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 could not be found. Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 could not be found. Apr 14 19:03:58 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:03:58 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-4b913743-a135-4ad6-a7d8-d4a9bf6e61fa tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Returning 404 to user: Instance 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:03:58 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-4b913743-a135-4ad6-a7d8-d4a9bf6e61fa tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" status: 404 len: 111 microversion: 2.87 time: 0.030627 Apr 14 19:03:58 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 291/863] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:03:58 2023] GET /compute/v2.1/servers/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 19:03:58 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:03:58 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:03:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:58 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Going to try to terminate instance {{(pid=61673) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 19:03:58 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6e79e2cb-54c5-487e-b852-49303ee3e3cc" status: 204 len: 0 microversion: 2.87 time: 0.130684 Apr 14 19:03:58 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 286/864] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 19:03:58 2023] DELETE /compute/v2.1/servers/6e79e2cb-54c5-487e-b852-49303ee3e3cc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 19:03:58 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-0456ad9f-54cc-4cf4-80c3-664a640b33c9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:03:58 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-0456ad9f-54cc-4cf4-80c3-664a640b33c9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:03:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0456ad9f-54cc-4cf4-80c3-664a640b33c9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0456ad9f-54cc-4cf4-80c3-664a640b33c9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0456ad9f-54cc-4cf4-80c3-664a640b33c9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0456ad9f-54cc-4cf4-80c3-664a640b33c9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0456ad9f-54cc-4cf4-80c3-664a640b33c9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0456ad9f-54cc-4cf4-80c3-664a640b33c9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:59 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-4d581c9a-7756-4b19-9928-0ccbac5c4f62 req-eca8600e-01a3-4893-9861-d4732030cff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e79e2cb-54c5-487e-b852-49303ee3e3cc", "name": "network-vif-unplugged", "status": "completed", "tag": "fdf3f209-95c6-4369-a6b6-13c2aed1371b"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:03:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-4d581c9a-7756-4b19-9928-0ccbac5c4f62 req-eca8600e-01a3-4893-9861-d4732030cff9 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-4d581c9a-7756-4b19-9928-0ccbac5c4f62 req-eca8600e-01a3-4893-9861-d4732030cff9 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-4d581c9a-7756-4b19-9928-0ccbac5c4f62 req-eca8600e-01a3-4893-9861-d4732030cff9 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:59 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-4d581c9a-7756-4b19-9928-0ccbac5c4f62 req-eca8600e-01a3-4893-9861-d4732030cff9 service nova] Creating event network-vif-unplugged:fdf3f209-95c6-4369-a6b6-13c2aed1371b for instance 6e79e2cb-54c5-487e-b852-49303ee3e3cc on user Apr 14 19:03:59 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-0456ad9f-54cc-4cf4-80c3-664a640b33c9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:03:59 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-4d581c9a-7756-4b19-9928-0ccbac5c4f62 req-eca8600e-01a3-4893-9861-d4732030cff9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035521 Apr 14 19:03:59 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 292/865] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:03:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:03:59 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-0456ad9f-54cc-4cf4-80c3-664a640b33c9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:03:59 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-0456ad9f-54cc-4cf4-80c3-664a640b33c9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:03:59 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-0456ad9f-54cc-4cf4-80c3-664a640b33c9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e79e2cb-54c5-487e-b852-49303ee3e3cc" status: 200 len: 1695 microversion: 2.87 time: 0.309304 Apr 14 19:03:59 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 288/866] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:03:58 2023] GET /compute/v2.1/servers/6e79e2cb-54c5-487e-b852-49303ee3e3cc => generated 1695 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 19:03:59 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-ecdaf521-21a0-4e05-88a3-0989225c7f76 req-6d75b424-ba6c-4c01-af18-5cb038dcdbf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4a54fb1-bd66-42f5-9f8c-9fb40470f468", "name": "network-vif-plugged", "status": "completed", "tag": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:03:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-ecdaf521-21a0-4e05-88a3-0989225c7f76 req-6d75b424-ba6c-4c01-af18-5cb038dcdbf2 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:03:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-ecdaf521-21a0-4e05-88a3-0989225c7f76 req-6d75b424-ba6c-4c01-af18-5cb038dcdbf2 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:03:59 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-ecdaf521-21a0-4e05-88a3-0989225c7f76 req-6d75b424-ba6c-4c01-af18-5cb038dcdbf2 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:03:59 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-ecdaf521-21a0-4e05-88a3-0989225c7f76 req-6d75b424-ba6c-4c01-af18-5cb038dcdbf2 service nova] Creating event network-vif-plugged:bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 for instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 on user Apr 14 19:03:59 user devstack@n-api.service[61673]: DEBUG nova.compute.api [req-ecdaf521-21a0-4e05-88a3-0989225c7f76 req-6d75b424-ba6c-4c01-af18-5cb038dcdbf2 service nova] Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61673) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 19:03:59 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-ecdaf521-21a0-4e05-88a3-0989225c7f76 req-6d75b424-ba6c-4c01-af18-5cb038dcdbf2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052065 Apr 14 19:03:59 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 287/867] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:03:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:04:00 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0ab062d-a039-4893-943e-25ed1de95160"}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:04:00 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:04:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:01 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-b5675e77-8831-4c90-9369-e5cc49d603ab req-f61df7e8-b59a-4fff-9246-65d079620834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e79e2cb-54c5-487e-b852-49303ee3e3cc", "name": "network-vif-plugged", "status": "completed", "tag": "fdf3f209-95c6-4369-a6b6-13c2aed1371b"}, {"server_uuid": "6e79e2cb-54c5-487e-b852-49303ee3e3cc", "name": "network-vif-deleted", "tag": "fdf3f209-95c6-4369-a6b6-13c2aed1371b"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:04:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-b5675e77-8831-4c90-9369-e5cc49d603ab req-f61df7e8-b59a-4fff-9246-65d079620834 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-b5675e77-8831-4c90-9369-e5cc49d603ab req-f61df7e8-b59a-4fff-9246-65d079620834 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-b5675e77-8831-4c90-9369-e5cc49d603ab req-f61df7e8-b59a-4fff-9246-65d079620834 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:01 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-b5675e77-8831-4c90-9369-e5cc49d603ab req-f61df7e8-b59a-4fff-9246-65d079620834 service nova] Creating event network-vif-plugged:fdf3f209-95c6-4369-a6b6-13c2aed1371b for instance 6e79e2cb-54c5-487e-b852-49303ee3e3cc on user Apr 14 19:04:01 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-b5675e77-8831-4c90-9369-e5cc49d603ab req-f61df7e8-b59a-4fff-9246-65d079620834 service nova] Creating event network-vif-deleted:fdf3f209-95c6-4369-a6b6-13c2aed1371b for instance 6e79e2cb-54c5-487e-b852-49303ee3e3cc on user Apr 14 19:04:01 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-b5675e77-8831-4c90-9369-e5cc49d603ab req-f61df7e8-b59a-4fff-9246-65d079620834 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034288 Apr 14 19:04:01 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 289/868] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:04:01 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:04:01 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "POST /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.359209 Apr 14 19:04:01 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 293/869] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 19:04:00 2023] POST /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f/os-volume_attachments => generated 194 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:04:08 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-e7a61689-dae8-461d-a37f-1d21c6ad8224 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:04:08 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-e7a61689-dae8-461d-a37f-1d21c6ad8224 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:04:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e7a61689-dae8-461d-a37f-1d21c6ad8224 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e7a61689-dae8-461d-a37f-1d21c6ad8224 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e7a61689-dae8-461d-a37f-1d21c6ad8224 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e7a61689-dae8-461d-a37f-1d21c6ad8224 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e7a61689-dae8-461d-a37f-1d21c6ad8224 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-e7a61689-dae8-461d-a37f-1d21c6ad8224 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:08 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-e7a61689-dae8-461d-a37f-1d21c6ad8224 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046746 Apr 14 19:04:08 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 288/870] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 19:04:08 2023] GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:04:08 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-038746cb-f19d-44ad-8242-b799de149863 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:04:08 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-038746cb-f19d-44ad-8242-b799de149863 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:04:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-038746cb-f19d-44ad-8242-b799de149863 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-038746cb-f19d-44ad-8242-b799de149863 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-038746cb-f19d-44ad-8242-b799de149863 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-038746cb-f19d-44ad-8242-b799de149863 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-038746cb-f19d-44ad-8242-b799de149863 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-038746cb-f19d-44ad-8242-b799de149863 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:08 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-038746cb-f19d-44ad-8242-b799de149863 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f/os-volume_attachments/afa35698-f508-4611-b895-bc408a4fb317" status: 200 len: 194 microversion: 2.1 time: 0.040331 Apr 14 19:04:08 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 290/871] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 19:04:08 2023] GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f/os-volume_attachments/afa35698-f508-4611-b895-bc408a4fb317 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:04:08 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:04:08 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:04:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:09 user devstack@n-api.service[61674]: DEBUG nova.objects.instance [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'services' on Instance uuid 15ebad56-cad0-4ab3-853f-72e3a3d2117f {{(pid=61674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 19:04:09 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f/os-volume_attachments/afa35698-f508-4611-b895-bc408a4fb317" status: 202 len: 0 microversion: 2.1 time: 0.183432 Apr 14 19:04:09 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 294/872] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 19:04:08 2023] DELETE /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f/os-volume_attachments/afa35698-f508-4611-b895-bc408a4fb317 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 19:04:11 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-fcee65e0-ff09-4ebf-bb71-43e220290d43 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:04:11 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-fcee65e0-ff09-4ebf-bb71-43e220290d43 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:04:11 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:04:11 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-fcee65e0-ff09-4ebf-bb71-43e220290d43 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:11 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-fcee65e0-ff09-4ebf-bb71-43e220290d43 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:11 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-fcee65e0-ff09-4ebf-bb71-43e220290d43 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:11 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-fcee65e0-ff09-4ebf-bb71-43e220290d43 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:11 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-fcee65e0-ff09-4ebf-bb71-43e220290d43 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:11 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-fcee65e0-ff09-4ebf-bb71-43e220290d43 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:11 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-fcee65e0-ff09-4ebf-bb71-43e220290d43 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f/os-volume_attachments/b0ab062d-a039-4893-943e-25ed1de95160" status: 200 len: 194 microversion: 2.1 time: 0.047085 Apr 14 19:04:11 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 289/873] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 19:04:11 2023] GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f/os-volume_attachments/b0ab062d-a039-4893-943e-25ed1de95160 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:04:11 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:04:11 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:04:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:11 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:11 user devstack@n-api.service[61675]: DEBUG nova.objects.instance [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'services' on Instance uuid 15ebad56-cad0-4ab3-853f-72e3a3d2117f {{(pid=61675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 19:04:11 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f/os-volume_attachments/b0ab062d-a039-4893-943e-25ed1de95160" status: 202 len: 0 microversion: 2.1 time: 0.176892 Apr 14 19:04:11 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 291/874] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 19:04:11 2023] DELETE /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f/os-volume_attachments/b0ab062d-a039-4893-943e-25ed1de95160 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 19:04:13 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-8bff0c06-7c8a-4164-a170-5f895a820c1c tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:04:13 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-8bff0c06-7c8a-4164-a170-5f895a820c1c tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:04:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8bff0c06-7c8a-4164-a170-5f895a820c1c tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8bff0c06-7c8a-4164-a170-5f895a820c1c tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8bff0c06-7c8a-4164-a170-5f895a820c1c tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8bff0c06-7c8a-4164-a170-5f895a820c1c tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8bff0c06-7c8a-4164-a170-5f895a820c1c tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8bff0c06-7c8a-4164-a170-5f895a820c1c tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:13 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-8bff0c06-7c8a-4164-a170-5f895a820c1c tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047297 Apr 14 19:04:13 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 295/875] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 19:04:13 2023] GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 19:04:13 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-066a978a-fe13-46a9-87fc-428545e28f1a tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:04:13 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-066a978a-fe13-46a9-87fc-428545e28f1a tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:04:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-066a978a-fe13-46a9-87fc-428545e28f1a tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-066a978a-fe13-46a9-87fc-428545e28f1a tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-066a978a-fe13-46a9-87fc-428545e28f1a tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-066a978a-fe13-46a9-87fc-428545e28f1a tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-066a978a-fe13-46a9-87fc-428545e28f1a tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-066a978a-fe13-46a9-87fc-428545e28f1a tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:13 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-066a978a-fe13-46a9-87fc-428545e28f1a tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046718 Apr 14 19:04:13 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 290/876] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 19:04:13 2023] GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 19:04:14 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:04:14 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:04:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:14 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Going to try to terminate instance {{(pid=61675) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 19:04:14 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f" status: 204 len: 0 microversion: 2.1 time: 0.110322 Apr 14 19:04:14 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 292/877] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:04:14 2023] DELETE /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 19:04:14 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-9fa68e39-6bf9-480f-95a5-db253f656583 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:04:14 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-9fa68e39-6bf9-480f-95a5-db253f656583 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:04:14 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-9fa68e39-6bf9-480f-95a5-db253f656583 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:14 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-9fa68e39-6bf9-480f-95a5-db253f656583 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:14 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-9fa68e39-6bf9-480f-95a5-db253f656583 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:14 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-9fa68e39-6bf9-480f-95a5-db253f656583 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:14 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-9fa68e39-6bf9-480f-95a5-db253f656583 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:14 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-9fa68e39-6bf9-480f-95a5-db253f656583 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:14 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-9fa68e39-6bf9-480f-95a5-db253f656583 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f90c8f23e3b42a98fdb9261db65f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf25bcc0dea4d3eb1284e8995eb3466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:04:14 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-9fa68e39-6bf9-480f-95a5-db253f656583 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f" status: 200 len: 1662 microversion: 2.1 time: 0.332655 Apr 14 19:04:14 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 296/878] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:04:14 2023] GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f => generated 1662 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:04:14 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-85944ee6-c03e-48c2-b0d5-4068c0e2e44a req-fc76a084-82a8-4c3a-91dc-359ca5a2c1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ebad56-cad0-4ab3-853f-72e3a3d2117f", "name": "network-vif-unplugged", "status": "completed", "tag": "08acb0d5-2432-42fe-a372-78f11a73ed56"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:04:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-85944ee6-c03e-48c2-b0d5-4068c0e2e44a req-fc76a084-82a8-4c3a-91dc-359ca5a2c1e5 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-85944ee6-c03e-48c2-b0d5-4068c0e2e44a req-fc76a084-82a8-4c3a-91dc-359ca5a2c1e5 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-85944ee6-c03e-48c2-b0d5-4068c0e2e44a req-fc76a084-82a8-4c3a-91dc-359ca5a2c1e5 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:14 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-85944ee6-c03e-48c2-b0d5-4068c0e2e44a req-fc76a084-82a8-4c3a-91dc-359ca5a2c1e5 service nova] Creating event network-vif-unplugged:08acb0d5-2432-42fe-a372-78f11a73ed56 for instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f on user Apr 14 19:04:14 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-85944ee6-c03e-48c2-b0d5-4068c0e2e44a req-fc76a084-82a8-4c3a-91dc-359ca5a2c1e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056997 Apr 14 19:04:14 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 291/879] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:04:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:04:16 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-bf5a2bea-170d-44e1-bd31-4f65637e1639 req-0b73ea7e-f26a-4217-a250-1ee1e29852d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ebad56-cad0-4ab3-853f-72e3a3d2117f", "name": "network-vif-deleted", "tag": "08acb0d5-2432-42fe-a372-78f11a73ed56"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:04:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-bf5a2bea-170d-44e1-bd31-4f65637e1639 req-0b73ea7e-f26a-4217-a250-1ee1e29852d6 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-bf5a2bea-170d-44e1-bd31-4f65637e1639 req-0b73ea7e-f26a-4217-a250-1ee1e29852d6 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-bf5a2bea-170d-44e1-bd31-4f65637e1639 req-0b73ea7e-f26a-4217-a250-1ee1e29852d6 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:16 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-bf5a2bea-170d-44e1-bd31-4f65637e1639 req-0b73ea7e-f26a-4217-a250-1ee1e29852d6 service nova] Creating event network-vif-deleted:08acb0d5-2432-42fe-a372-78f11a73ed56 for instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f on user Apr 14 19:04:16 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-bf5a2bea-170d-44e1-bd31-4f65637e1639 req-0b73ea7e-f26a-4217-a250-1ee1e29852d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030438 Apr 14 19:04:16 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 293/880] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:04:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:04:16 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-a4687877-1bd1-4985-aaf6-00b899a530be req-f8fff15e-4ab4-4b85-acdc-7a8b6cf944c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ebad56-cad0-4ab3-853f-72e3a3d2117f", "name": "network-vif-plugged", "status": "completed", "tag": "08acb0d5-2432-42fe-a372-78f11a73ed56"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:04:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-a4687877-1bd1-4985-aaf6-00b899a530be req-f8fff15e-4ab4-4b85-acdc-7a8b6cf944c6 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-a4687877-1bd1-4985-aaf6-00b899a530be req-f8fff15e-4ab4-4b85-acdc-7a8b6cf944c6 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:16 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-a4687877-1bd1-4985-aaf6-00b899a530be req-f8fff15e-4ab4-4b85-acdc-7a8b6cf944c6 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:16 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-a4687877-1bd1-4985-aaf6-00b899a530be req-f8fff15e-4ab4-4b85-acdc-7a8b6cf944c6 service nova] Creating event network-vif-plugged:08acb0d5-2432-42fe-a372-78f11a73ed56 for instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f on user Apr 14 19:04:16 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-a4687877-1bd1-4985-aaf6-00b899a530be req-f8fff15e-4ab4-4b85-acdc-7a8b6cf944c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032133 Apr 14 19:04:16 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 297/881] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:04:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:04:17 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-cb86371e-3aba-4c36-9e3d-83965f6bf956 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:04:17 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-cb86371e-3aba-4c36-9e3d-83965f6bf956 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:04:17 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-cb86371e-3aba-4c36-9e3d-83965f6bf956 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:17 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-cb86371e-3aba-4c36-9e3d-83965f6bf956 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:17 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-cb86371e-3aba-4c36-9e3d-83965f6bf956 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:17 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-cb86371e-3aba-4c36-9e3d-83965f6bf956 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:17 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-cb86371e-3aba-4c36-9e3d-83965f6bf956 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:17 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-cb86371e-3aba-4c36-9e3d-83965f6bf956 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:17 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-cb86371e-3aba-4c36-9e3d-83965f6bf956 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:04:17 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-cb86371e-3aba-4c36-9e3d-83965f6bf956 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:04:17 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-cb86371e-3aba-4c36-9e3d-83965f6bf956 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:04:17 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-cb86371e-3aba-4c36-9e3d-83965f6bf956 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a" status: 200 len: 1588 microversion: 2.20 time: 0.246593 Apr 14 19:04:17 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 292/882] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:04:17 2023] GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a => generated 1588 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 19:04:19 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-824d10fd-b11f-49c7-93d6-6786bb76210d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:04:19 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-824d10fd-b11f-49c7-93d6-6786bb76210d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:04:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-824d10fd-b11f-49c7-93d6-6786bb76210d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-824d10fd-b11f-49c7-93d6-6786bb76210d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-824d10fd-b11f-49c7-93d6-6786bb76210d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-824d10fd-b11f-49c7-93d6-6786bb76210d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-824d10fd-b11f-49c7-93d6-6786bb76210d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-824d10fd-b11f-49c7-93d6-6786bb76210d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:19 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-824d10fd-b11f-49c7-93d6-6786bb76210d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] HTTP exception thrown: Instance 56097076-1e63-41ba-8331-be8ede06c537 could not be found. Apr 14 19:04:19 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-824d10fd-b11f-49c7-93d6-6786bb76210d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Request method failure captured: Apr 14 19:04:19 user devstack@n-api.service[61675]: request: GET /compute/v2.1/servers/56097076-1e63-41ba-8331-be8ede06c537 HTTP/1.1 Apr 14 19:04:19 user devstack@n-api.service[61675]: Accept: application/json Apr 14 19:04:19 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 19:04:19 user devstack@n-api.service[61675]: Connection: close Apr 14 19:04:19 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 19:04:19 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 19:04:19 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 19:04:19 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 19:04:19 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOaGjzEHP4gR4MoApqz0vJpRX2_SvaMHlWJEk_fU7mYw99OWl-qUsSQ6rEQ6kqDrRwocqp34lWfQib95-KwgiyuwPlyVpsmwfmwLReClbkEHff7utOAgEbSdfwWoPS9VLZQQ0SJcp_M6aCZY6cryOh5BrJ2VueTzigMFoaeOsa0D5fWA Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Project-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Project-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Tenant: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Tenant-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:04:19 user devstack@n-api.service[61675]: X-User: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 19:04:19 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 19:04:19 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 19:04:19 user devstack@n-api.service[61675]: X-User-Id: fc3bed70703a49c8bdec2f50193c7f70 Apr 14 19:04:19 user devstack@n-api.service[61675]: X-User-Name: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 19:04:19 user devstack@n-api.service[61675]: method: > Apr 14 19:04:19 user devstack@n-api.service[61675]: exception: Instance 56097076-1e63-41ba-8331-be8ede06c537 could not be found. Apr 14 19:04:19 user devstack@n-api.service[61675]: action_args: {'id': '56097076-1e63-41ba-8331-be8ede06c537'} Apr 14 19:04:19 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56097076-1e63-41ba-8331-be8ede06c537 could not be found. Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56097076-1e63-41ba-8331-be8ede06c537 could not be found. Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56097076-1e63-41ba-8331-be8ede06c537 could not be found. Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:04:19 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-824d10fd-b11f-49c7-93d6-6786bb76210d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Returning 404 to user: Instance 56097076-1e63-41ba-8331-be8ede06c537 could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:04:19 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-824d10fd-b11f-49c7-93d6-6786bb76210d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56097076-1e63-41ba-8331-be8ede06c537" status: 404 len: 111 microversion: 2.1 time: 0.028850 Apr 14 19:04:19 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 294/883] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:04:19 2023] GET /compute/v2.1/servers/56097076-1e63-41ba-8331-be8ede06c537 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:04:19 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-6c2217da-a67a-4614-bcec-7cda384ec7b5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:04:19 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-6c2217da-a67a-4614-bcec-7cda384ec7b5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:04:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6c2217da-a67a-4614-bcec-7cda384ec7b5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6c2217da-a67a-4614-bcec-7cda384ec7b5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6c2217da-a67a-4614-bcec-7cda384ec7b5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6c2217da-a67a-4614-bcec-7cda384ec7b5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6c2217da-a67a-4614-bcec-7cda384ec7b5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6c2217da-a67a-4614-bcec-7cda384ec7b5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:19 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-6c2217da-a67a-4614-bcec-7cda384ec7b5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] HTTP exception thrown: Instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 could not be found. Apr 14 19:04:19 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-6c2217da-a67a-4614-bcec-7cda384ec7b5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Request method failure captured: Apr 14 19:04:19 user devstack@n-api.service[61674]: request: DELETE /compute/v2.1/servers/698bc2dc-aff4-4148-b80e-8b77c846faf7 HTTP/1.1 Apr 14 19:04:19 user devstack@n-api.service[61674]: Accept: application/json Apr 14 19:04:19 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 19:04:19 user devstack@n-api.service[61674]: Connection: close Apr 14 19:04:19 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 19:04:19 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 19:04:19 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 19:04:19 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 19:04:19 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOaGjzEHP4gR4MoApqz0vJpRX2_SvaMHlWJEk_fU7mYw99OWl-qUsSQ6rEQ6kqDrRwocqp34lWfQib95-KwgiyuwPlyVpsmwfmwLReClbkEHff7utOAgEbSdfwWoPS9VLZQQ0SJcp_M6aCZY6cryOh5BrJ2VueTzigMFoaeOsa0D5fWA Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Project-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Project-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Tenant: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Tenant-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:04:19 user devstack@n-api.service[61674]: X-User: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 19:04:19 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 19:04:19 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 19:04:19 user devstack@n-api.service[61674]: X-User-Id: fc3bed70703a49c8bdec2f50193c7f70 Apr 14 19:04:19 user devstack@n-api.service[61674]: X-User-Name: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 19:04:19 user devstack@n-api.service[61674]: method: > Apr 14 19:04:19 user devstack@n-api.service[61674]: exception: Instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 could not be found. Apr 14 19:04:19 user devstack@n-api.service[61674]: action_args: {'id': '698bc2dc-aff4-4148-b80e-8b77c846faf7'} Apr 14 19:04:19 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 could not be found. Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 could not be found. Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 could not be found. Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:04:19 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-6c2217da-a67a-4614-bcec-7cda384ec7b5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Returning 404 to user: Instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:04:19 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-6c2217da-a67a-4614-bcec-7cda384ec7b5 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/698bc2dc-aff4-4148-b80e-8b77c846faf7" status: 404 len: 111 microversion: 2.1 time: 0.038097 Apr 14 19:04:19 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 298/884] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:04:19 2023] DELETE /compute/v2.1/servers/698bc2dc-aff4-4148-b80e-8b77c846faf7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:04:19 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-dbb8a23d-3672-476b-84c4-99ec08711540 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:04:19 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-dbb8a23d-3672-476b-84c4-99ec08711540 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:04:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-dbb8a23d-3672-476b-84c4-99ec08711540 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-dbb8a23d-3672-476b-84c4-99ec08711540 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-dbb8a23d-3672-476b-84c4-99ec08711540 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-dbb8a23d-3672-476b-84c4-99ec08711540 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-dbb8a23d-3672-476b-84c4-99ec08711540 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-dbb8a23d-3672-476b-84c4-99ec08711540 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:19 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-dbb8a23d-3672-476b-84c4-99ec08711540 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] HTTP exception thrown: Instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 could not be found. Apr 14 19:04:19 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-dbb8a23d-3672-476b-84c4-99ec08711540 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Request method failure captured: Apr 14 19:04:19 user devstack@n-api.service[61673]: request: GET /compute/v2.1/servers/698bc2dc-aff4-4148-b80e-8b77c846faf7 HTTP/1.1 Apr 14 19:04:19 user devstack@n-api.service[61673]: Accept: application/json Apr 14 19:04:19 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 19:04:19 user devstack@n-api.service[61673]: Connection: close Apr 14 19:04:19 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 19:04:19 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 19:04:19 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 19:04:19 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 19:04:19 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 19:04:19 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOaGjzEHP4gR4MoApqz0vJpRX2_SvaMHlWJEk_fU7mYw99OWl-qUsSQ6rEQ6kqDrRwocqp34lWfQib95-KwgiyuwPlyVpsmwfmwLReClbkEHff7utOAgEbSdfwWoPS9VLZQQ0SJcp_M6aCZY6cryOh5BrJ2VueTzigMFoaeOsa0D5fWA Apr 14 19:04:19 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 19:04:19 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 19:04:19 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 19:04:19 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 19:04:19 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 19:04:19 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 19:04:19 user devstack@n-api.service[61673]: X-Project-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 19:04:19 user devstack@n-api.service[61673]: X-Project-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:04:19 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 19:04:19 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 19:04:19 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:04:19 user devstack@n-api.service[61673]: X-Tenant: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:04:19 user devstack@n-api.service[61673]: X-Tenant-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 19:04:19 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:04:19 user devstack@n-api.service[61673]: X-User: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 19:04:19 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 19:04:19 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 19:04:19 user devstack@n-api.service[61673]: X-User-Id: fc3bed70703a49c8bdec2f50193c7f70 Apr 14 19:04:19 user devstack@n-api.service[61673]: X-User-Name: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 19:04:19 user devstack@n-api.service[61673]: method: > Apr 14 19:04:19 user devstack@n-api.service[61673]: exception: Instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 could not be found. Apr 14 19:04:19 user devstack@n-api.service[61673]: action_args: {'id': '698bc2dc-aff4-4148-b80e-8b77c846faf7'} Apr 14 19:04:19 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 could not be found. Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 could not be found. Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 could not be found. Apr 14 19:04:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:04:19 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-dbb8a23d-3672-476b-84c4-99ec08711540 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Returning 404 to user: Instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:04:19 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-dbb8a23d-3672-476b-84c4-99ec08711540 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/698bc2dc-aff4-4148-b80e-8b77c846faf7" status: 404 len: 111 microversion: 2.1 time: 0.035635 Apr 14 19:04:19 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 293/885] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:04:19 2023] GET /compute/v2.1/servers/698bc2dc-aff4-4148-b80e-8b77c846faf7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:04:19 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-a25f204b-6805-4492-964f-c5a375fb38d1 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:04:19 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-a25f204b-6805-4492-964f-c5a375fb38d1 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:04:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a25f204b-6805-4492-964f-c5a375fb38d1 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a25f204b-6805-4492-964f-c5a375fb38d1 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a25f204b-6805-4492-964f-c5a375fb38d1 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a25f204b-6805-4492-964f-c5a375fb38d1 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a25f204b-6805-4492-964f-c5a375fb38d1 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a25f204b-6805-4492-964f-c5a375fb38d1 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:19 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-a25f204b-6805-4492-964f-c5a375fb38d1 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] HTTP exception thrown: Instance 56097076-1e63-41ba-8331-be8ede06c537 could not be found. Apr 14 19:04:19 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-a25f204b-6805-4492-964f-c5a375fb38d1 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Request method failure captured: Apr 14 19:04:19 user devstack@n-api.service[61675]: request: DELETE /compute/v2.1/servers/56097076-1e63-41ba-8331-be8ede06c537 HTTP/1.1 Apr 14 19:04:19 user devstack@n-api.service[61675]: Accept: application/json Apr 14 19:04:19 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 19:04:19 user devstack@n-api.service[61675]: Connection: close Apr 14 19:04:19 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 19:04:19 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 19:04:19 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 19:04:19 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 19:04:19 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOaGjzEHP4gR4MoApqz0vJpRX2_SvaMHlWJEk_fU7mYw99OWl-qUsSQ6rEQ6kqDrRwocqp34lWfQib95-KwgiyuwPlyVpsmwfmwLReClbkEHff7utOAgEbSdfwWoPS9VLZQQ0SJcp_M6aCZY6cryOh5BrJ2VueTzigMFoaeOsa0D5fWA Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Project-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Project-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Tenant: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Tenant-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 19:04:19 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:04:19 user devstack@n-api.service[61675]: X-User: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 19:04:19 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 19:04:19 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 19:04:19 user devstack@n-api.service[61675]: X-User-Id: fc3bed70703a49c8bdec2f50193c7f70 Apr 14 19:04:19 user devstack@n-api.service[61675]: X-User-Name: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 19:04:19 user devstack@n-api.service[61675]: method: > Apr 14 19:04:19 user devstack@n-api.service[61675]: exception: Instance 56097076-1e63-41ba-8331-be8ede06c537 could not be found. Apr 14 19:04:19 user devstack@n-api.service[61675]: action_args: {'id': '56097076-1e63-41ba-8331-be8ede06c537'} Apr 14 19:04:19 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56097076-1e63-41ba-8331-be8ede06c537 could not be found. Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56097076-1e63-41ba-8331-be8ede06c537 could not be found. Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56097076-1e63-41ba-8331-be8ede06c537 could not be found. Apr 14 19:04:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:04:19 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-a25f204b-6805-4492-964f-c5a375fb38d1 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Returning 404 to user: Instance 56097076-1e63-41ba-8331-be8ede06c537 could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:04:19 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-a25f204b-6805-4492-964f-c5a375fb38d1 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/56097076-1e63-41ba-8331-be8ede06c537" status: 404 len: 111 microversion: 2.1 time: 0.028330 Apr 14 19:04:19 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 295/886] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:04:19 2023] DELETE /compute/v2.1/servers/56097076-1e63-41ba-8331-be8ede06c537 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 19:04:19 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-2d481061-c48d-4b13-b13a-a113215f2f1b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:04:19 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-2d481061-c48d-4b13-b13a-a113215f2f1b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:04:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-2d481061-c48d-4b13-b13a-a113215f2f1b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-2d481061-c48d-4b13-b13a-a113215f2f1b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-2d481061-c48d-4b13-b13a-a113215f2f1b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-2d481061-c48d-4b13-b13a-a113215f2f1b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-2d481061-c48d-4b13-b13a-a113215f2f1b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-2d481061-c48d-4b13-b13a-a113215f2f1b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:19 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-2d481061-c48d-4b13-b13a-a113215f2f1b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] HTTP exception thrown: Instance 56097076-1e63-41ba-8331-be8ede06c537 could not be found. Apr 14 19:04:19 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-2d481061-c48d-4b13-b13a-a113215f2f1b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Request method failure captured: Apr 14 19:04:19 user devstack@n-api.service[61674]: request: GET /compute/v2.1/servers/56097076-1e63-41ba-8331-be8ede06c537 HTTP/1.1 Apr 14 19:04:19 user devstack@n-api.service[61674]: Accept: application/json Apr 14 19:04:19 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 19:04:19 user devstack@n-api.service[61674]: Connection: close Apr 14 19:04:19 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 19:04:19 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 19:04:19 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 19:04:19 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 19:04:19 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOaGjzEHP4gR4MoApqz0vJpRX2_SvaMHlWJEk_fU7mYw99OWl-qUsSQ6rEQ6kqDrRwocqp34lWfQib95-KwgiyuwPlyVpsmwfmwLReClbkEHff7utOAgEbSdfwWoPS9VLZQQ0SJcp_M6aCZY6cryOh5BrJ2VueTzigMFoaeOsa0D5fWA Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Project-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Project-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Tenant: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Tenant-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 19:04:19 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:04:19 user devstack@n-api.service[61674]: X-User: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 19:04:19 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 19:04:19 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 19:04:19 user devstack@n-api.service[61674]: X-User-Id: fc3bed70703a49c8bdec2f50193c7f70 Apr 14 19:04:19 user devstack@n-api.service[61674]: X-User-Name: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 19:04:19 user devstack@n-api.service[61674]: method: > Apr 14 19:04:19 user devstack@n-api.service[61674]: exception: Instance 56097076-1e63-41ba-8331-be8ede06c537 could not be found. Apr 14 19:04:19 user devstack@n-api.service[61674]: action_args: {'id': '56097076-1e63-41ba-8331-be8ede06c537'} Apr 14 19:04:19 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56097076-1e63-41ba-8331-be8ede06c537 could not be found. Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56097076-1e63-41ba-8331-be8ede06c537 could not be found. Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56097076-1e63-41ba-8331-be8ede06c537 could not be found. Apr 14 19:04:19 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:04:19 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-2d481061-c48d-4b13-b13a-a113215f2f1b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Returning 404 to user: Instance 56097076-1e63-41ba-8331-be8ede06c537 could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:04:19 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-2d481061-c48d-4b13-b13a-a113215f2f1b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56097076-1e63-41ba-8331-be8ede06c537" status: 404 len: 111 microversion: 2.1 time: 0.033006 Apr 14 19:04:19 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 299/887] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:04:19 2023] GET /compute/v2.1/servers/56097076-1e63-41ba-8331-be8ede06c537 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:04:19 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-68d9b349-2c90-499e-835e-5441cc91d458 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Action: 'create', calling method: .version_select at 0x7fdae137c670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-875294368", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLH6wEzI6wPr3HSI9syj/GXqtR434CPMv842eEH8Ur7optAijphl3X5nnx3wGhFElGA6ZShGSL9fAqXmiCuCFvkN96Ba8TxlbqJJF0iuZdKqgxLb5+y5P1MWLM//CZYHg=="}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:04:19 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-68d9b349-2c90-499e-835e-5441cc91d458 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Getting quotas for project 72d2bf68325a4a18934a8403571c24bb. Resources: {'key_pairs'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 19:04:19 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-68d9b349-2c90-499e-835e-5441cc91d458 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Getting quotas for user fc3bed70703a49c8bdec2f50193c7f70 and project 72d2bf68325a4a18934a8403571c24bb. Resources: {'key_pairs'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 19:04:19 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-68d9b349-2c90-499e-835e-5441cc91d458 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.048170 Apr 14 19:04:19 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 294/888] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 19:04:19 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:04:24 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-152862803", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-875294368", "security_groups": [{"name": "tempest-secgroup-smoke-304973525"}], "block_device_mapping_v2": [{"uuid": "126e30a2-deeb-433e-a8b5-e9970ffc15af", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70"}]}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:04:24 user devstack@n-api.service[61675]: DEBUG nova.network.neutron [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] validate_networks() for [('bfa4fdbb-10b3-4715-9ff2-b717d052cc70', None, None, None, None, None)] {{(pid=61675) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 19:04:25 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flavor limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 19:04:25 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Image limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 19:04:25 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flavor pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 19:04:25 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Image pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 19:04:25 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 19:04:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:25 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Getting quotas for project 72d2bf68325a4a18934a8403571c24bb. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 19:04:25 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Getting quotas for user fc3bed70703a49c8bdec2f50193c7f70 and project 72d2bf68325a4a18934a8403571c24bb. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 19:04:25 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Going to run 1 instances... {{(pid=61675) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 19:04:25 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='126e30a2-deeb-433e-a8b5-e9970ffc15af',volume_size=None,volume_type=None)] {{(pid=61675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 19:04:25 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.914411 Apr 14 19:04:25 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 296/889] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 19:04:24 2023] POST /compute/v2.1/servers => generated 403 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 19:04:25 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-0d8c181a-a31f-4550-aa48-944f46f08b5a tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:04:25 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-0d8c181a-a31f-4550-aa48-944f46f08b5a tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:04:25 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-0d8c181a-a31f-4550-aa48-944f46f08b5a tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:04:25 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-0d8c181a-a31f-4550-aa48-944f46f08b5a tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3fde6b1-ddc9-400e-a032-f80cd32bad39" status: 200 len: 1088 microversion: 2.1 time: 0.073741 Apr 14 19:04:25 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 300/890] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:04:25 2023] GET /compute/v2.1/servers/f3fde6b1-ddc9-400e-a032-f80cd32bad39 => generated 1088 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:04:28 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-fa113b31-ccc0-4dd5-8bc3-498252448916 req-19769a40-c690-4120-bad6-c74433cc8bdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3fde6b1-ddc9-400e-a032-f80cd32bad39", "tag": "7527e5c9-4845-43dd-970d-b0072b4c0639"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:04:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-fa113b31-ccc0-4dd5-8bc3-498252448916 req-19769a40-c690-4120-bad6-c74433cc8bdc service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-fa113b31-ccc0-4dd5-8bc3-498252448916 req-19769a40-c690-4120-bad6-c74433cc8bdc service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:28 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-fa113b31-ccc0-4dd5-8bc3-498252448916 req-19769a40-c690-4120-bad6-c74433cc8bdc service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:28 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:04:28 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-fa113b31-ccc0-4dd5-8bc3-498252448916 req-19769a40-c690-4120-bad6-c74433cc8bdc service nova] Creating event network-changed:7527e5c9-4845-43dd-970d-b0072b4c0639 for instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 on user Apr 14 19:04:28 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-fa113b31-ccc0-4dd5-8bc3-498252448916 req-19769a40-c690-4120-bad6-c74433cc8bdc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035922 Apr 14 19:04:28 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 295/891] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:04:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:04:32 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-e9372848-928c-4205-85e9-f681d4acc8e7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:04:32 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-e9372848-928c-4205-85e9-f681d4acc8e7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:04:32 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:04:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e9372848-928c-4205-85e9-f681d4acc8e7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e9372848-928c-4205-85e9-f681d4acc8e7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e9372848-928c-4205-85e9-f681d4acc8e7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e9372848-928c-4205-85e9-f681d4acc8e7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e9372848-928c-4205-85e9-f681d4acc8e7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-e9372848-928c-4205-85e9-f681d4acc8e7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:32 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:04:32 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-e9372848-928c-4205-85e9-f681d4acc8e7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:04:32 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-e9372848-928c-4205-85e9-f681d4acc8e7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468" status: 200 len: 1554 microversion: 2.1 time: 0.256497 Apr 14 19:04:32 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 297/892] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:04:32 2023] GET /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468 => generated 1554 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:04:34 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-11678f70-62a1-46bc-929c-7aefd3a711ee req-f03ab6ab-4cbc-491e-8f13-c34240e63bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fde6b1-ddc9-400e-a032-f80cd32bad39", "name": "network-vif-plugged", "status": "completed", "tag": "7527e5c9-4845-43dd-970d-b0072b4c0639"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:04:34 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:04:34 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=24 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:04:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-11678f70-62a1-46bc-929c-7aefd3a711ee req-f03ab6ab-4cbc-491e-8f13-c34240e63bcb service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-11678f70-62a1-46bc-929c-7aefd3a711ee req-f03ab6ab-4cbc-491e-8f13-c34240e63bcb service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-11678f70-62a1-46bc-929c-7aefd3a711ee req-f03ab6ab-4cbc-491e-8f13-c34240e63bcb service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:34 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-11678f70-62a1-46bc-929c-7aefd3a711ee req-f03ab6ab-4cbc-491e-8f13-c34240e63bcb service nova] Creating event network-vif-plugged:7527e5c9-4845-43dd-970d-b0072b4c0639 for instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 on user Apr 14 19:04:34 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-11678f70-62a1-46bc-929c-7aefd3a711ee req-f03ab6ab-4cbc-491e-8f13-c34240e63bcb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038202 Apr 14 19:04:34 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 301/893] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:04:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:04:35 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-78b8ee54-59c8-4ece-b392-d6d6a7acd1f3 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:04:35 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-78b8ee54-59c8-4ece-b392-d6d6a7acd1f3 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:04:35 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=4 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:04:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-78b8ee54-59c8-4ece-b392-d6d6a7acd1f3 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-78b8ee54-59c8-4ece-b392-d6d6a7acd1f3 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-78b8ee54-59c8-4ece-b392-d6d6a7acd1f3 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-78b8ee54-59c8-4ece-b392-d6d6a7acd1f3 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-78b8ee54-59c8-4ece-b392-d6d6a7acd1f3 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:35 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-78b8ee54-59c8-4ece-b392-d6d6a7acd1f3 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:35 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-78b8ee54-59c8-4ece-b392-d6d6a7acd1f3 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10cf3683f78d4724bb734e5280e8736b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81575e6ed9bc41d2ad2ac1ad0fbd253d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:04:35 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-78b8ee54-59c8-4ece-b392-d6d6a7acd1f3 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be" status: 200 len: 1568 microversion: 2.1 time: 0.315977 Apr 14 19:04:35 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 296/894] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:04:35 2023] GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be => generated 1568 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:04:36 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-4b5551e1-a177-4200-98a4-299d99e064ab req-6b277796-54b3-4ea9-8459-4fa845c8d19a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fde6b1-ddc9-400e-a032-f80cd32bad39", "name": "network-vif-plugged", "status": "completed", "tag": "7527e5c9-4845-43dd-970d-b0072b4c0639"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:04:36 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:04:36 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=6 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:04:36 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-4b5551e1-a177-4200-98a4-299d99e064ab req-6b277796-54b3-4ea9-8459-4fa845c8d19a service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:36 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-4b5551e1-a177-4200-98a4-299d99e064ab req-6b277796-54b3-4ea9-8459-4fa845c8d19a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:36 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-4b5551e1-a177-4200-98a4-299d99e064ab req-6b277796-54b3-4ea9-8459-4fa845c8d19a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:36 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-4b5551e1-a177-4200-98a4-299d99e064ab req-6b277796-54b3-4ea9-8459-4fa845c8d19a service nova] Creating event network-vif-plugged:7527e5c9-4845-43dd-970d-b0072b4c0639 for instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 on user Apr 14 19:04:36 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-4b5551e1-a177-4200-98a4-299d99e064ab req-6b277796-54b3-4ea9-8459-4fa845c8d19a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042155 Apr 14 19:04:36 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 298/895] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:04:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:04:42 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:04:42 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-4c9ea607-44fb-40d3-abe4-acc2f1419c10 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:04:42 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-4c9ea607-44fb-40d3-abe4-acc2f1419c10 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:04:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4c9ea607-44fb-40d3-abe4-acc2f1419c10 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4c9ea607-44fb-40d3-abe4-acc2f1419c10 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4c9ea607-44fb-40d3-abe4-acc2f1419c10 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4c9ea607-44fb-40d3-abe4-acc2f1419c10 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4c9ea607-44fb-40d3-abe4-acc2f1419c10 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4c9ea607-44fb-40d3-abe4-acc2f1419c10 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:42 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-4c9ea607-44fb-40d3-abe4-acc2f1419c10 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.241410 Apr 14 19:04:42 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 302/896] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 19:04:42 2023] GET /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58/os-interface => generated 283 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:04:43 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-585afcbc-94bb-47e8-a3fe-bcf817befeb7 req-8d7d725c-cc75-4b1e-8636-d742ed51eda8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05891511-e84c-4fe3-a688-edcc27849d58", "tag": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:04:43 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:04:43 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-585afcbc-94bb-47e8-a3fe-bcf817befeb7 req-8d7d725c-cc75-4b1e-8636-d742ed51eda8 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:43 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-585afcbc-94bb-47e8-a3fe-bcf817befeb7 req-8d7d725c-cc75-4b1e-8636-d742ed51eda8 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:43 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-585afcbc-94bb-47e8-a3fe-bcf817befeb7 req-8d7d725c-cc75-4b1e-8636-d742ed51eda8 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:43 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-585afcbc-94bb-47e8-a3fe-bcf817befeb7 req-8d7d725c-cc75-4b1e-8636-d742ed51eda8 service nova] Creating event network-changed:dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance 05891511-e84c-4fe3-a688-edcc27849d58 on user Apr 14 19:04:43 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-585afcbc-94bb-47e8-a3fe-bcf817befeb7 req-8d7d725c-cc75-4b1e-8636-d742ed51eda8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034521 Apr 14 19:04:43 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 297/897] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:04:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:04:43 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:04:43 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:04:43 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:43 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:43 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:43 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:43 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:43 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:43 user devstack@n-api.service[61675]: DEBUG nova.objects.instance [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'services' on Instance uuid 05891511-e84c-4fe3-a688-edcc27849d58 {{(pid=61675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 19:04:43 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58/os-volume_attachments/61176d19-dc87-4e57-9b3c-6ba547a237eb" status: 202 len: 0 microversion: 2.1 time: 0.174105 Apr 14 19:04:43 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 299/898] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 19:04:43 2023] DELETE /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58/os-volume_attachments/61176d19-dc87-4e57-9b3c-6ba547a237eb => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 19:04:43 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-49c8d2b5-ef81-400a-97c3-53b1b1b3dd13 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:04:43 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-49c8d2b5-ef81-400a-97c3-53b1b1b3dd13 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:04:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-49c8d2b5-ef81-400a-97c3-53b1b1b3dd13 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-49c8d2b5-ef81-400a-97c3-53b1b1b3dd13 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-49c8d2b5-ef81-400a-97c3-53b1b1b3dd13 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-49c8d2b5-ef81-400a-97c3-53b1b1b3dd13 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-49c8d2b5-ef81-400a-97c3-53b1b1b3dd13 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-49c8d2b5-ef81-400a-97c3-53b1b1b3dd13 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:43 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-49c8d2b5-ef81-400a-97c3-53b1b1b3dd13 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052407 Apr 14 19:04:43 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 303/899] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 19:04:43 2023] GET /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:04:45 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-61049dd6-9990-4b1b-90f9-0d87a4cecf36 req-051abb91-5ba5-44d2-9a92-e46da1a2f4e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05891511-e84c-4fe3-a688-edcc27849d58", "tag": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:04:45 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-61049dd6-9990-4b1b-90f9-0d87a4cecf36 req-051abb91-5ba5-44d2-9a92-e46da1a2f4e7 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:45 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-61049dd6-9990-4b1b-90f9-0d87a4cecf36 req-051abb91-5ba5-44d2-9a92-e46da1a2f4e7 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:45 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-61049dd6-9990-4b1b-90f9-0d87a4cecf36 req-051abb91-5ba5-44d2-9a92-e46da1a2f4e7 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:45 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-61049dd6-9990-4b1b-90f9-0d87a4cecf36 req-051abb91-5ba5-44d2-9a92-e46da1a2f4e7 service nova] Creating event network-changed:dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance 05891511-e84c-4fe3-a688-edcc27849d58 on user Apr 14 19:04:45 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-61049dd6-9990-4b1b-90f9-0d87a4cecf36 req-051abb91-5ba5-44d2-9a92-e46da1a2f4e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029052 Apr 14 19:04:45 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 298/900] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:04:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:04:49 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-c00d76a5-d45d-4c8a-a459-85299fcae788 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:04:49 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-c00d76a5-d45d-4c8a-a459-85299fcae788 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:04:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c00d76a5-d45d-4c8a-a459-85299fcae788 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c00d76a5-d45d-4c8a-a459-85299fcae788 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c00d76a5-d45d-4c8a-a459-85299fcae788 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c00d76a5-d45d-4c8a-a459-85299fcae788 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c00d76a5-d45d-4c8a-a459-85299fcae788 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c00d76a5-d45d-4c8a-a459-85299fcae788 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:49 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-c00d76a5-d45d-4c8a-a459-85299fcae788 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] HTTP exception thrown: Instance 6e79e2cb-54c5-487e-b852-49303ee3e3cc could not be found. Apr 14 19:04:49 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-c00d76a5-d45d-4c8a-a459-85299fcae788 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Request method failure captured: Apr 14 19:04:49 user devstack@n-api.service[61675]: request: GET /compute/v2.1/servers/6e79e2cb-54c5-487e-b852-49303ee3e3cc HTTP/1.1 Apr 14 19:04:49 user devstack@n-api.service[61675]: Accept: application/json Apr 14 19:04:49 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 19:04:49 user devstack@n-api.service[61675]: Connection: close Apr 14 19:04:49 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 19:04:49 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 19:04:49 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 19:04:49 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 19:04:49 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 19:04:49 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOZ9nnPCXT2QdXSPWwVlCjp7pyXFpgrlAX-vfX50Qxai2B6k6Sv9Eh_PLls3HRJrj-Jv-x2WsQVnktQmvPcAus0yc32hEM2J2lZCmpZH6vf8f7he9r8FkKysH7AamOkQjdnbmnS_op_MrAg4cU3dqmaIghoDPfOx6PuY0hLvr2DGIzJg Apr 14 19:04:49 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 19:04:49 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 19:04:49 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 19:04:49 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 19:04:49 user devstack@n-api.service[61675]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 19:04:49 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 19:04:49 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 19:04:49 user devstack@n-api.service[61675]: X-Project-Id: 424e732759884efa8fd126cd9a082c8a Apr 14 19:04:49 user devstack@n-api.service[61675]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1815450365 Apr 14 19:04:49 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 19:04:49 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 19:04:49 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/424e732759884efa8fd126cd9a082c8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/424e732759884efa8fd126cd9a082c8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/424e732759884efa8fd126cd9a082c8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:04:49 user devstack@n-api.service[61675]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1815450365 Apr 14 19:04:49 user devstack@n-api.service[61675]: X-Tenant-Id: 424e732759884efa8fd126cd9a082c8a Apr 14 19:04:49 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1815450365 Apr 14 19:04:49 user devstack@n-api.service[61675]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member Apr 14 19:04:49 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 19:04:49 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 19:04:49 user devstack@n-api.service[61675]: X-User-Id: a644b8bb9b90494ba670da8315bfe005 Apr 14 19:04:49 user devstack@n-api.service[61675]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member Apr 14 19:04:49 user devstack@n-api.service[61675]: method: > Apr 14 19:04:49 user devstack@n-api.service[61675]: exception: Instance 6e79e2cb-54c5-487e-b852-49303ee3e3cc could not be found. Apr 14 19:04:49 user devstack@n-api.service[61675]: action_args: {'id': '6e79e2cb-54c5-487e-b852-49303ee3e3cc'} Apr 14 19:04:49 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e79e2cb-54c5-487e-b852-49303ee3e3cc could not be found. Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e79e2cb-54c5-487e-b852-49303ee3e3cc could not be found. Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e79e2cb-54c5-487e-b852-49303ee3e3cc could not be found. Apr 14 19:04:49 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:04:49 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-c00d76a5-d45d-4c8a-a459-85299fcae788 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Returning 404 to user: Instance 6e79e2cb-54c5-487e-b852-49303ee3e3cc could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:04:49 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-c00d76a5-d45d-4c8a-a459-85299fcae788 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e79e2cb-54c5-487e-b852-49303ee3e3cc" status: 404 len: 111 microversion: 2.87 time: 0.030337 Apr 14 19:04:49 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 300/901] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:04:49 2023] GET /compute/v2.1/servers/6e79e2cb-54c5-487e-b852-49303ee3e3cc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 14 19:04:49 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:04:49 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:04:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:49 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:49 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Going to try to terminate instance {{(pid=61674) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 19:04:49 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/23d14a51-41aa-4827-bd60-c605d9689bc8" status: 204 len: 0 microversion: 2.87 time: 0.190655 Apr 14 19:04:49 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 304/902] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 19:04:49 2023] DELETE /compute/v2.1/servers/23d14a51-41aa-4827-bd60-c605d9689bc8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 19:04:49 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-b9040a40-0a48-49c6-97b0-9bf046f8437a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:04:49 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-b9040a40-0a48-49c6-97b0-9bf046f8437a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:04:49 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b9040a40-0a48-49c6-97b0-9bf046f8437a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:49 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b9040a40-0a48-49c6-97b0-9bf046f8437a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:49 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b9040a40-0a48-49c6-97b0-9bf046f8437a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:49 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b9040a40-0a48-49c6-97b0-9bf046f8437a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:49 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b9040a40-0a48-49c6-97b0-9bf046f8437a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:49 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b9040a40-0a48-49c6-97b0-9bf046f8437a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:49 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-e216209c-7c91-4f9d-9d91-d169f2bf3913 req-8d7c9652-eead-4abe-ba60-f5ebeeb49dfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d14a51-41aa-4827-bd60-c605d9689bc8", "name": "network-vif-unplugged", "status": "completed", "tag": "b8044678-899b-4461-bbf0-cf9fd662e71e"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:04:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-e216209c-7c91-4f9d-9d91-d169f2bf3913 req-8d7c9652-eead-4abe-ba60-f5ebeeb49dfc service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-e216209c-7c91-4f9d-9d91-d169f2bf3913 req-8d7c9652-eead-4abe-ba60-f5ebeeb49dfc service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-e216209c-7c91-4f9d-9d91-d169f2bf3913 req-8d7c9652-eead-4abe-ba60-f5ebeeb49dfc service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:49 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-e216209c-7c91-4f9d-9d91-d169f2bf3913 req-8d7c9652-eead-4abe-ba60-f5ebeeb49dfc service nova] Creating event network-vif-unplugged:b8044678-899b-4461-bbf0-cf9fd662e71e for instance 23d14a51-41aa-4827-bd60-c605d9689bc8 on user Apr 14 19:04:49 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-e216209c-7c91-4f9d-9d91-d169f2bf3913 req-8d7c9652-eead-4abe-ba60-f5ebeeb49dfc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033027 Apr 14 19:04:49 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 301/903] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:04:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:04:49 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-b9040a40-0a48-49c6-97b0-9bf046f8437a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:04:49 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-b9040a40-0a48-49c6-97b0-9bf046f8437a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:04:49 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-b9040a40-0a48-49c6-97b0-9bf046f8437a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:04:49 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-b9040a40-0a48-49c6-97b0-9bf046f8437a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23d14a51-41aa-4827-bd60-c605d9689bc8" status: 200 len: 1774 microversion: 2.87 time: 0.524845 Apr 14 19:04:49 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 299/904] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:04:49 2023] GET /compute/v2.1/servers/23d14a51-41aa-4827-bd60-c605d9689bc8 => generated 1774 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 19:04:51 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-609ef733-e75c-4a10-b7aa-28513a0c16d9 req-60c2598f-97dc-418e-a32d-2c8c834a6df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d14a51-41aa-4827-bd60-c605d9689bc8", "name": "network-vif-deleted", "tag": "b8044678-899b-4461-bbf0-cf9fd662e71e"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:04:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-609ef733-e75c-4a10-b7aa-28513a0c16d9 req-60c2598f-97dc-418e-a32d-2c8c834a6df4 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-609ef733-e75c-4a10-b7aa-28513a0c16d9 req-60c2598f-97dc-418e-a32d-2c8c834a6df4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-609ef733-e75c-4a10-b7aa-28513a0c16d9 req-60c2598f-97dc-418e-a32d-2c8c834a6df4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:51 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-609ef733-e75c-4a10-b7aa-28513a0c16d9 req-60c2598f-97dc-418e-a32d-2c8c834a6df4 service nova] Creating event network-vif-deleted:b8044678-899b-4461-bbf0-cf9fd662e71e for instance 23d14a51-41aa-4827-bd60-c605d9689bc8 on user Apr 14 19:04:51 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-609ef733-e75c-4a10-b7aa-28513a0c16d9 req-60c2598f-97dc-418e-a32d-2c8c834a6df4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031904 Apr 14 19:04:51 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 305/905] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:04:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:04:51 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-311f7458-29fd-449b-9922-bf96a106f6ea req-045245d9-4fc7-4d84-af97-c5192e626c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d14a51-41aa-4827-bd60-c605d9689bc8", "name": "network-vif-plugged", "status": "completed", "tag": "b8044678-899b-4461-bbf0-cf9fd662e71e"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:04:51 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-311f7458-29fd-449b-9922-bf96a106f6ea req-045245d9-4fc7-4d84-af97-c5192e626c85 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:04:51 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-311f7458-29fd-449b-9922-bf96a106f6ea req-045245d9-4fc7-4d84-af97-c5192e626c85 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:04:51 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-311f7458-29fd-449b-9922-bf96a106f6ea req-045245d9-4fc7-4d84-af97-c5192e626c85 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:04:51 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-311f7458-29fd-449b-9922-bf96a106f6ea req-045245d9-4fc7-4d84-af97-c5192e626c85 service nova] Creating event network-vif-plugged:b8044678-899b-4461-bbf0-cf9fd662e71e for instance 23d14a51-41aa-4827-bd60-c605d9689bc8 on user Apr 14 19:04:51 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-311f7458-29fd-449b-9922-bf96a106f6ea req-045245d9-4fc7-4d84-af97-c5192e626c85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029908 Apr 14 19:04:51 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 302/906] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:04:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:05:04 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-a5478aa4-58b3-4687-9fb7-d46c85995fdb tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:04 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-a5478aa4-58b3-4687-9fb7-d46c85995fdb tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:05:04 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=17 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:05:04 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=7 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:05:04 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a5478aa4-58b3-4687-9fb7-d46c85995fdb tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:04 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a5478aa4-58b3-4687-9fb7-d46c85995fdb tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:04 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a5478aa4-58b3-4687-9fb7-d46c85995fdb tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:04 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a5478aa4-58b3-4687-9fb7-d46c85995fdb tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:04 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a5478aa4-58b3-4687-9fb7-d46c85995fdb tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:04 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a5478aa4-58b3-4687-9fb7-d46c85995fdb tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:04 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-a5478aa4-58b3-4687-9fb7-d46c85995fdb tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] HTTP exception thrown: Instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f could not be found. Apr 14 19:05:04 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-a5478aa4-58b3-4687-9fb7-d46c85995fdb tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Request method failure captured: Apr 14 19:05:04 user devstack@n-api.service[61673]: request: GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f HTTP/1.1 Apr 14 19:05:04 user devstack@n-api.service[61673]: Accept: application/json Apr 14 19:05:04 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 19:05:04 user devstack@n-api.service[61673]: Connection: close Apr 14 19:05:04 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 19:05:04 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 19:05:04 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 19:05:04 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 19:05:04 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 19:05:04 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOaCvR0LdZ-tjyVt6oQb6IpAgKVYAlnVECPgmlFqHUNZvZKpQkmNaJw21aRTTyI6wUYicoaM5yM0KU8UJU3OXhqcuiP4L4ZASGKPVL_8u7uHGRlWBAK0UAE8OGdjrOcvkalE_7bVUYOPe7Eh_4yg_nEIAFWChbaZqV4fsXjL7cjmG4FU Apr 14 19:05:04 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 19:05:04 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 19:05:04 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 19:05:04 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 19:05:04 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 19:05:04 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 19:05:04 user devstack@n-api.service[61673]: X-Project-Id: edf25bcc0dea4d3eb1284e8995eb3466 Apr 14 19:05:04 user devstack@n-api.service[61673]: X-Project-Name: tempest-AttachVolumeTestJSON-1126291015 Apr 14 19:05:04 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 19:05:04 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 19:05:04 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/edf25bcc0dea4d3eb1284e8995eb3466"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/edf25bcc0dea4d3eb1284e8995eb3466"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/edf25bcc0dea4d3eb1284e8995eb3466"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:05:04 user devstack@n-api.service[61673]: X-Tenant: tempest-AttachVolumeTestJSON-1126291015 Apr 14 19:05:04 user devstack@n-api.service[61673]: X-Tenant-Id: edf25bcc0dea4d3eb1284e8995eb3466 Apr 14 19:05:04 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1126291015 Apr 14 19:05:04 user devstack@n-api.service[61673]: X-User: tempest-AttachVolumeTestJSON-1126291015-project-member Apr 14 19:05:04 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 19:05:04 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 19:05:04 user devstack@n-api.service[61673]: X-User-Id: 9f90c8f23e3b42a98fdb9261db65f547 Apr 14 19:05:04 user devstack@n-api.service[61673]: X-User-Name: tempest-AttachVolumeTestJSON-1126291015-project-member Apr 14 19:05:04 user devstack@n-api.service[61673]: method: > Apr 14 19:05:04 user devstack@n-api.service[61673]: exception: Instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f could not be found. Apr 14 19:05:04 user devstack@n-api.service[61673]: action_args: {'id': '15ebad56-cad0-4ab3-853f-72e3a3d2117f'} Apr 14 19:05:04 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f could not be found. Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f could not be found. Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f could not be found. Apr 14 19:05:04 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:05:04 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-a5478aa4-58b3-4687-9fb7-d46c85995fdb tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Returning 404 to user: Instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:05:04 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-a5478aa4-58b3-4687-9fb7-d46c85995fdb tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f" status: 404 len: 111 microversion: 2.1 time: 0.043538 Apr 14 19:05:04 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 300/907] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:05:04 2023] GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:05:04 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:05:04 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:05:04 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-a62adfcf-c6d3-4b38-a564-a85996fb7208 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '.version_select at 0x7fdae2aa9fc0>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:04 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-a62adfcf-c6d3-4b38-a564-a85996fb7208 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1109149281" status: 202 len: 0 microversion: 2.1 time: 0.032250 Apr 14 19:05:04 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 306/908] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 19:05:04 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1109149281 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 19:05:12 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-da813a86-2d9c-4c30-a93e-a69bdf8a42f8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:12 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-da813a86-2d9c-4c30-a93e-a69bdf8a42f8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:05:12 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=11 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:05:12 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=22,nova_cell1:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:05:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-da813a86-2d9c-4c30-a93e-a69bdf8a42f8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-da813a86-2d9c-4c30-a93e-a69bdf8a42f8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-da813a86-2d9c-4c30-a93e-a69bdf8a42f8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-da813a86-2d9c-4c30-a93e-a69bdf8a42f8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-da813a86-2d9c-4c30-a93e-a69bdf8a42f8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:12 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-da813a86-2d9c-4c30-a93e-a69bdf8a42f8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:12 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-da813a86-2d9c-4c30-a93e-a69bdf8a42f8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] HTTP exception thrown: Instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f could not be found. Apr 14 19:05:12 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-da813a86-2d9c-4c30-a93e-a69bdf8a42f8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Request method failure captured: Apr 14 19:05:12 user devstack@n-api.service[61675]: request: DELETE /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f HTTP/1.1 Apr 14 19:05:12 user devstack@n-api.service[61675]: Accept: application/json Apr 14 19:05:12 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 19:05:12 user devstack@n-api.service[61675]: Connection: close Apr 14 19:05:12 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 19:05:12 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 19:05:12 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 19:05:12 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 19:05:12 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 19:05:12 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOaCvR0LdZ-tjyVt6oQb6IpAgKVYAlnVECPgmlFqHUNZvZKpQkmNaJw21aRTTyI6wUYicoaM5yM0KU8UJU3OXhqcuiP4L4ZASGKPVL_8u7uHGRlWBAK0UAE8OGdjrOcvkalE_7bVUYOPe7Eh_4yg_nEIAFWChbaZqV4fsXjL7cjmG4FU Apr 14 19:05:12 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 19:05:12 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 19:05:12 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 19:05:12 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 19:05:12 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 19:05:12 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 19:05:12 user devstack@n-api.service[61675]: X-Project-Id: edf25bcc0dea4d3eb1284e8995eb3466 Apr 14 19:05:12 user devstack@n-api.service[61675]: X-Project-Name: tempest-AttachVolumeTestJSON-1126291015 Apr 14 19:05:12 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 19:05:12 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 19:05:12 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/edf25bcc0dea4d3eb1284e8995eb3466"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/edf25bcc0dea4d3eb1284e8995eb3466"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/edf25bcc0dea4d3eb1284e8995eb3466"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:05:12 user devstack@n-api.service[61675]: X-Tenant: tempest-AttachVolumeTestJSON-1126291015 Apr 14 19:05:12 user devstack@n-api.service[61675]: X-Tenant-Id: edf25bcc0dea4d3eb1284e8995eb3466 Apr 14 19:05:12 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1126291015 Apr 14 19:05:12 user devstack@n-api.service[61675]: X-User: tempest-AttachVolumeTestJSON-1126291015-project-member Apr 14 19:05:12 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 19:05:12 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 19:05:12 user devstack@n-api.service[61675]: X-User-Id: 9f90c8f23e3b42a98fdb9261db65f547 Apr 14 19:05:12 user devstack@n-api.service[61675]: X-User-Name: tempest-AttachVolumeTestJSON-1126291015-project-member Apr 14 19:05:12 user devstack@n-api.service[61675]: method: > Apr 14 19:05:12 user devstack@n-api.service[61675]: exception: Instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f could not be found. Apr 14 19:05:12 user devstack@n-api.service[61675]: action_args: {'id': '15ebad56-cad0-4ab3-853f-72e3a3d2117f'} Apr 14 19:05:12 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f could not be found. Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f could not be found. Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f could not be found. Apr 14 19:05:12 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:05:12 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-da813a86-2d9c-4c30-a93e-a69bdf8a42f8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Returning 404 to user: Instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:05:12 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-da813a86-2d9c-4c30-a93e-a69bdf8a42f8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f" status: 404 len: 111 microversion: 2.1 time: 0.034501 Apr 14 19:05:12 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 303/909] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:05:12 2023] DELETE /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:05:12 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-6811751e-56b2-42e2-b1d7-f57fb609dd05 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:12 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-6811751e-56b2-42e2-b1d7-f57fb609dd05 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:05:12 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6811751e-56b2-42e2-b1d7-f57fb609dd05 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:12 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6811751e-56b2-42e2-b1d7-f57fb609dd05 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:12 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6811751e-56b2-42e2-b1d7-f57fb609dd05 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:12 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6811751e-56b2-42e2-b1d7-f57fb609dd05 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:12 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6811751e-56b2-42e2-b1d7-f57fb609dd05 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:12 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6811751e-56b2-42e2-b1d7-f57fb609dd05 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:12 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-6811751e-56b2-42e2-b1d7-f57fb609dd05 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] HTTP exception thrown: Instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f could not be found. Apr 14 19:05:12 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-6811751e-56b2-42e2-b1d7-f57fb609dd05 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Request method failure captured: Apr 14 19:05:12 user devstack@n-api.service[61673]: request: GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f HTTP/1.1 Apr 14 19:05:12 user devstack@n-api.service[61673]: Accept: application/json Apr 14 19:05:12 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 19:05:12 user devstack@n-api.service[61673]: Connection: close Apr 14 19:05:12 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 19:05:12 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 19:05:12 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 19:05:12 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 19:05:12 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 19:05:12 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOaCvR0LdZ-tjyVt6oQb6IpAgKVYAlnVECPgmlFqHUNZvZKpQkmNaJw21aRTTyI6wUYicoaM5yM0KU8UJU3OXhqcuiP4L4ZASGKPVL_8u7uHGRlWBAK0UAE8OGdjrOcvkalE_7bVUYOPe7Eh_4yg_nEIAFWChbaZqV4fsXjL7cjmG4FU Apr 14 19:05:12 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 19:05:12 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 19:05:12 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 19:05:12 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 19:05:12 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 19:05:12 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 19:05:12 user devstack@n-api.service[61673]: X-Project-Id: edf25bcc0dea4d3eb1284e8995eb3466 Apr 14 19:05:12 user devstack@n-api.service[61673]: X-Project-Name: tempest-AttachVolumeTestJSON-1126291015 Apr 14 19:05:12 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 19:05:12 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 19:05:12 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/edf25bcc0dea4d3eb1284e8995eb3466"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/edf25bcc0dea4d3eb1284e8995eb3466"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/edf25bcc0dea4d3eb1284e8995eb3466"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:05:12 user devstack@n-api.service[61673]: X-Tenant: tempest-AttachVolumeTestJSON-1126291015 Apr 14 19:05:12 user devstack@n-api.service[61673]: X-Tenant-Id: edf25bcc0dea4d3eb1284e8995eb3466 Apr 14 19:05:12 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1126291015 Apr 14 19:05:12 user devstack@n-api.service[61673]: X-User: tempest-AttachVolumeTestJSON-1126291015-project-member Apr 14 19:05:12 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 19:05:12 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 19:05:12 user devstack@n-api.service[61673]: X-User-Id: 9f90c8f23e3b42a98fdb9261db65f547 Apr 14 19:05:12 user devstack@n-api.service[61673]: X-User-Name: tempest-AttachVolumeTestJSON-1126291015-project-member Apr 14 19:05:12 user devstack@n-api.service[61673]: method: > Apr 14 19:05:12 user devstack@n-api.service[61673]: exception: Instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f could not be found. Apr 14 19:05:12 user devstack@n-api.service[61673]: action_args: {'id': '15ebad56-cad0-4ab3-853f-72e3a3d2117f'} Apr 14 19:05:12 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f could not be found. Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f could not be found. Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f could not be found. Apr 14 19:05:12 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:05:12 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-6811751e-56b2-42e2-b1d7-f57fb609dd05 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Returning 404 to user: Instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:05:12 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-6811751e-56b2-42e2-b1d7-f57fb609dd05 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f" status: 404 len: 111 microversion: 2.1 time: 0.026999 Apr 14 19:05:12 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 301/910] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:05:12 2023] GET /compute/v2.1/servers/15ebad56-cad0-4ab3-853f-72e3a3d2117f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:05:15 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:05:15 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-6cdac04e-01a9-4029-85cf-72b23178fd9e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:15 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-6cdac04e-01a9-4029-85cf-72b23178fd9e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:05:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6cdac04e-01a9-4029-85cf-72b23178fd9e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6cdac04e-01a9-4029-85cf-72b23178fd9e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6cdac04e-01a9-4029-85cf-72b23178fd9e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6cdac04e-01a9-4029-85cf-72b23178fd9e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6cdac04e-01a9-4029-85cf-72b23178fd9e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6cdac04e-01a9-4029-85cf-72b23178fd9e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:15 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-6cdac04e-01a9-4029-85cf-72b23178fd9e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] HTTP exception thrown: Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 could not be found. Apr 14 19:05:15 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-6cdac04e-01a9-4029-85cf-72b23178fd9e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Request method failure captured: Apr 14 19:05:15 user devstack@n-api.service[61674]: request: DELETE /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4 HTTP/1.1 Apr 14 19:05:15 user devstack@n-api.service[61674]: Accept: application/json Apr 14 19:05:15 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 19:05:15 user devstack@n-api.service[61674]: Connection: close Apr 14 19:05:15 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 19:05:15 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 19:05:15 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 19:05:15 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 19:05:15 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 19:05:15 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOaCvR0LdZ-tjyVt6oQb6IpAgKVYAlnVECPgmlFqHUNZvZKpQkmNaJw21aRTTyI6wUYicoaM5yM0KU8UJU3OXhqcuiP4L4ZASGKPVL_8u7uHGRlWBAK0UAE8OGdjrOcvkalE_7bVUYOPe7Eh_4yg_nEIAFWChbaZqV4fsXjL7cjmG4FU Apr 14 19:05:15 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 19:05:15 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 19:05:15 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 19:05:15 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 19:05:15 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 19:05:15 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 19:05:15 user devstack@n-api.service[61674]: X-Project-Id: edf25bcc0dea4d3eb1284e8995eb3466 Apr 14 19:05:15 user devstack@n-api.service[61674]: X-Project-Name: tempest-AttachVolumeTestJSON-1126291015 Apr 14 19:05:15 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 19:05:15 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 19:05:15 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/edf25bcc0dea4d3eb1284e8995eb3466"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/edf25bcc0dea4d3eb1284e8995eb3466"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/edf25bcc0dea4d3eb1284e8995eb3466"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:05:15 user devstack@n-api.service[61674]: X-Tenant: tempest-AttachVolumeTestJSON-1126291015 Apr 14 19:05:15 user devstack@n-api.service[61674]: X-Tenant-Id: edf25bcc0dea4d3eb1284e8995eb3466 Apr 14 19:05:15 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1126291015 Apr 14 19:05:15 user devstack@n-api.service[61674]: X-User: tempest-AttachVolumeTestJSON-1126291015-project-member Apr 14 19:05:15 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 19:05:15 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 19:05:15 user devstack@n-api.service[61674]: X-User-Id: 9f90c8f23e3b42a98fdb9261db65f547 Apr 14 19:05:15 user devstack@n-api.service[61674]: X-User-Name: tempest-AttachVolumeTestJSON-1126291015-project-member Apr 14 19:05:15 user devstack@n-api.service[61674]: method: > Apr 14 19:05:15 user devstack@n-api.service[61674]: exception: Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 could not be found. Apr 14 19:05:15 user devstack@n-api.service[61674]: action_args: {'id': '0050e6bb-0b53-4fdc-8437-16b94ee79fa4'} Apr 14 19:05:15 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 could not be found. Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 could not be found. Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 could not be found. Apr 14 19:05:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:05:15 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-6cdac04e-01a9-4029-85cf-72b23178fd9e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Returning 404 to user: Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:05:15 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-6cdac04e-01a9-4029-85cf-72b23178fd9e tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4" status: 404 len: 111 microversion: 2.1 time: 0.033406 Apr 14 19:05:15 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 307/911] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:05:15 2023] DELETE /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:05:15 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-c2373a57-398e-4c92-8b67-005266968716 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:15 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-c2373a57-398e-4c92-8b67-005266968716 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:05:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c2373a57-398e-4c92-8b67-005266968716 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c2373a57-398e-4c92-8b67-005266968716 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c2373a57-398e-4c92-8b67-005266968716 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c2373a57-398e-4c92-8b67-005266968716 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c2373a57-398e-4c92-8b67-005266968716 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c2373a57-398e-4c92-8b67-005266968716 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:15 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-c2373a57-398e-4c92-8b67-005266968716 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] HTTP exception thrown: Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 could not be found. Apr 14 19:05:15 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-c2373a57-398e-4c92-8b67-005266968716 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Request method failure captured: Apr 14 19:05:15 user devstack@n-api.service[61675]: request: GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4 HTTP/1.1 Apr 14 19:05:15 user devstack@n-api.service[61675]: Accept: application/json Apr 14 19:05:15 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 19:05:15 user devstack@n-api.service[61675]: Connection: close Apr 14 19:05:15 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 19:05:15 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 19:05:15 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 19:05:15 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 19:05:15 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 19:05:15 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOaCvR0LdZ-tjyVt6oQb6IpAgKVYAlnVECPgmlFqHUNZvZKpQkmNaJw21aRTTyI6wUYicoaM5yM0KU8UJU3OXhqcuiP4L4ZASGKPVL_8u7uHGRlWBAK0UAE8OGdjrOcvkalE_7bVUYOPe7Eh_4yg_nEIAFWChbaZqV4fsXjL7cjmG4FU Apr 14 19:05:15 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 19:05:15 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 19:05:15 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 19:05:15 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 19:05:15 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 19:05:15 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 19:05:15 user devstack@n-api.service[61675]: X-Project-Id: edf25bcc0dea4d3eb1284e8995eb3466 Apr 14 19:05:15 user devstack@n-api.service[61675]: X-Project-Name: tempest-AttachVolumeTestJSON-1126291015 Apr 14 19:05:15 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 19:05:15 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 19:05:15 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/edf25bcc0dea4d3eb1284e8995eb3466"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/edf25bcc0dea4d3eb1284e8995eb3466"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/edf25bcc0dea4d3eb1284e8995eb3466"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:05:15 user devstack@n-api.service[61675]: X-Tenant: tempest-AttachVolumeTestJSON-1126291015 Apr 14 19:05:15 user devstack@n-api.service[61675]: X-Tenant-Id: edf25bcc0dea4d3eb1284e8995eb3466 Apr 14 19:05:15 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1126291015 Apr 14 19:05:15 user devstack@n-api.service[61675]: X-User: tempest-AttachVolumeTestJSON-1126291015-project-member Apr 14 19:05:15 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 19:05:15 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 19:05:15 user devstack@n-api.service[61675]: X-User-Id: 9f90c8f23e3b42a98fdb9261db65f547 Apr 14 19:05:15 user devstack@n-api.service[61675]: X-User-Name: tempest-AttachVolumeTestJSON-1126291015-project-member Apr 14 19:05:15 user devstack@n-api.service[61675]: method: > Apr 14 19:05:15 user devstack@n-api.service[61675]: exception: Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 could not be found. Apr 14 19:05:15 user devstack@n-api.service[61675]: action_args: {'id': '0050e6bb-0b53-4fdc-8437-16b94ee79fa4'} Apr 14 19:05:15 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 could not be found. Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 could not be found. Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 could not be found. Apr 14 19:05:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:05:15 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-c2373a57-398e-4c92-8b67-005266968716 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Returning 404 to user: Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:05:15 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-c2373a57-398e-4c92-8b67-005266968716 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4" status: 404 len: 111 microversion: 2.1 time: 0.031723 Apr 14 19:05:15 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 304/912] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:05:15 2023] GET /compute/v2.1/servers/0050e6bb-0b53-4fdc-8437-16b94ee79fa4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:05:15 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-5edb0e46-4c11-409a-9f03-70b5509e1b89 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:15 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-5edb0e46-4c11-409a-9f03-70b5509e1b89 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:05:15 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5edb0e46-4c11-409a-9f03-70b5509e1b89 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:15 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5edb0e46-4c11-409a-9f03-70b5509e1b89 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:15 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5edb0e46-4c11-409a-9f03-70b5509e1b89 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:15 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5edb0e46-4c11-409a-9f03-70b5509e1b89 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:15 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5edb0e46-4c11-409a-9f03-70b5509e1b89 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:15 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5edb0e46-4c11-409a-9f03-70b5509e1b89 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:15 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-5edb0e46-4c11-409a-9f03-70b5509e1b89 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:05:15 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-5edb0e46-4c11-409a-9f03-70b5509e1b89 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3fde6b1-ddc9-400e-a032-f80cd32bad39" status: 200 len: 1439 microversion: 2.1 time: 0.244329 Apr 14 19:05:15 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 302/913] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:05:15 2023] GET /compute/v2.1/servers/f3fde6b1-ddc9-400e-a032-f80cd32bad39 => generated 1439 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:05:17 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-5a8dda4b-cb6f-4b5e-be94-f781fe6186a4 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:18 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-5a8dda4b-cb6f-4b5e-be94-f781fe6186a4 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:05:18 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5a8dda4b-cb6f-4b5e-be94-f781fe6186a4 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:18 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5a8dda4b-cb6f-4b5e-be94-f781fe6186a4 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:18 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5a8dda4b-cb6f-4b5e-be94-f781fe6186a4 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:18 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5a8dda4b-cb6f-4b5e-be94-f781fe6186a4 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:18 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5a8dda4b-cb6f-4b5e-be94-f781fe6186a4 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:18 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-5a8dda4b-cb6f-4b5e-be94-f781fe6186a4 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:18 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-5a8dda4b-cb6f-4b5e-be94-f781fe6186a4 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.542443 Apr 14 19:05:18 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 308/914] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 19:05:17 2023] GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a/os-interface => generated 282 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 19:05:19 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-e85b82fa-132c-4f3e-a16b-4302fd9e74f3 req-2bbbed2b-696a-4e2c-8dd5-556b0d452238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "179270ef-7866-4ee7-af13-ec3ea5e7525a", "tag": "fef01e15-9070-4b0b-ba18-0b9540774cb9"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:05:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-e85b82fa-132c-4f3e-a16b-4302fd9e74f3 req-2bbbed2b-696a-4e2c-8dd5-556b0d452238 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-e85b82fa-132c-4f3e-a16b-4302fd9e74f3 req-2bbbed2b-696a-4e2c-8dd5-556b0d452238 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-e85b82fa-132c-4f3e-a16b-4302fd9e74f3 req-2bbbed2b-696a-4e2c-8dd5-556b0d452238 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:19 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-e85b82fa-132c-4f3e-a16b-4302fd9e74f3 req-2bbbed2b-696a-4e2c-8dd5-556b0d452238 service nova] Creating event network-changed:fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance 179270ef-7866-4ee7-af13-ec3ea5e7525a on user Apr 14 19:05:19 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-e85b82fa-132c-4f3e-a16b-4302fd9e74f3 req-2bbbed2b-696a-4e2c-8dd5-556b0d452238 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034819 Apr 14 19:05:19 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 305/915] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:05:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:05:19 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-9286109a-0c5a-44e8-a3a7-f05d8c1cda76 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:19 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-9286109a-0c5a-44e8-a3a7-f05d8c1cda76 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:05:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9286109a-0c5a-44e8-a3a7-f05d8c1cda76 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9286109a-0c5a-44e8-a3a7-f05d8c1cda76 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9286109a-0c5a-44e8-a3a7-f05d8c1cda76 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9286109a-0c5a-44e8-a3a7-f05d8c1cda76 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9286109a-0c5a-44e8-a3a7-f05d8c1cda76 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-9286109a-0c5a-44e8-a3a7-f05d8c1cda76 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:19 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-9286109a-0c5a-44e8-a3a7-f05d8c1cda76 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a/ips" status: 200 len: 110 microversion: 2.20 time: 0.036904 Apr 14 19:05:19 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 303/916] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 14 19:05:19 2023] GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a/ips => generated 110 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 19:05:21 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:05:21 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:05:21 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:21 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:21 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:21 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:21 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:21 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:22 user devstack@n-api.service[61674]: DEBUG nova.objects.instance [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lazy-loading 'flavor' on Instance uuid 179270ef-7866-4ee7-af13-ec3ea5e7525a {{(pid=61674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 19:05:22 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "POST /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a/action" status: 202 len: 0 microversion: 2.20 time: 0.910093 Apr 14 19:05:22 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 309/917] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 19:05:21 2023] POST /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a/action => generated 0 bytes in 914 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 19:05:22 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-96918f0e-cd1d-4bb0-a136-4d9349c81dff tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:22 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-96918f0e-cd1d-4bb0-a136-4d9349c81dff tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:05:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-96918f0e-cd1d-4bb0-a136-4d9349c81dff tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-96918f0e-cd1d-4bb0-a136-4d9349c81dff tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-96918f0e-cd1d-4bb0-a136-4d9349c81dff tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-96918f0e-cd1d-4bb0-a136-4d9349c81dff tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-96918f0e-cd1d-4bb0-a136-4d9349c81dff tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:22 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-96918f0e-cd1d-4bb0-a136-4d9349c81dff tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:23 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-96918f0e-cd1d-4bb0-a136-4d9349c81dff tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:05:23 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-96918f0e-cd1d-4bb0-a136-4d9349c81dff tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:05:23 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-96918f0e-cd1d-4bb0-a136-4d9349c81dff tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:05:23 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-96918f0e-cd1d-4bb0-a136-4d9349c81dff tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a" status: 200 len: 1712 microversion: 2.20 time: 0.200141 Apr 14 19:05:23 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 306/918] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:05:22 2023] GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a => generated 1712 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 19:05:23 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-efa8ac3e-5340-41a0-871d-a20e1474f205 req-17884ce1-3715-4a19-88c9-171215587370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179270ef-7866-4ee7-af13-ec3ea5e7525a", "name": "network-vif-unplugged", "status": "completed", "tag": "fef01e15-9070-4b0b-ba18-0b9540774cb9"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:05:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-efa8ac3e-5340-41a0-871d-a20e1474f205 req-17884ce1-3715-4a19-88c9-171215587370 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-efa8ac3e-5340-41a0-871d-a20e1474f205 req-17884ce1-3715-4a19-88c9-171215587370 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-efa8ac3e-5340-41a0-871d-a20e1474f205 req-17884ce1-3715-4a19-88c9-171215587370 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:23 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-efa8ac3e-5340-41a0-871d-a20e1474f205 req-17884ce1-3715-4a19-88c9-171215587370 service nova] Creating event network-vif-unplugged:fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance 179270ef-7866-4ee7-af13-ec3ea5e7525a on user Apr 14 19:05:23 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-efa8ac3e-5340-41a0-871d-a20e1474f205 req-17884ce1-3715-4a19-88c9-171215587370 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033500 Apr 14 19:05:23 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 304/919] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:05:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:05:24 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-7912c3b7-6e69-436d-b41d-2dc4d9ab0caa tempest-VolumesTestJSON-1090279077 tempest-VolumesTestJSON-1090279077-project-member] Calling method '.version_select at 0x7fdae114b760>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:24 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-7912c3b7-6e69-436d-b41d-2dc4d9ab0caa tempest-VolumesTestJSON-1090279077 tempest-VolumesTestJSON-1090279077-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c699ea4e-aad4-4114-872d-301222dfe555" status: 200 len: 351 microversion: 2.1 time: 0.053500 Apr 14 19:05:24 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 310/920] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 19:05:24 2023] GET /compute/v2.1/os-volumes/c699ea4e-aad4-4114-872d-301222dfe555 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:05:25 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-957dbc85-19dc-4052-bbbd-669d2bb11fc1 req-582d1c51-4e55-478c-b3b1-be9d21d54f3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179270ef-7866-4ee7-af13-ec3ea5e7525a", "name": "network-vif-plugged", "status": "completed", "tag": "fef01e15-9070-4b0b-ba18-0b9540774cb9"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:05:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-957dbc85-19dc-4052-bbbd-669d2bb11fc1 req-582d1c51-4e55-478c-b3b1-be9d21d54f3e service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-957dbc85-19dc-4052-bbbd-669d2bb11fc1 req-582d1c51-4e55-478c-b3b1-be9d21d54f3e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-957dbc85-19dc-4052-bbbd-669d2bb11fc1 req-582d1c51-4e55-478c-b3b1-be9d21d54f3e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:25 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-957dbc85-19dc-4052-bbbd-669d2bb11fc1 req-582d1c51-4e55-478c-b3b1-be9d21d54f3e service nova] Creating event network-vif-plugged:fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance 179270ef-7866-4ee7-af13-ec3ea5e7525a on user Apr 14 19:05:25 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-957dbc85-19dc-4052-bbbd-669d2bb11fc1 req-582d1c51-4e55-478c-b3b1-be9d21d54f3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035982 Apr 14 19:05:25 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 307/921] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:05:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:05:27 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-dfff8297-9d75-434c-863d-e76d74e13e91 tempest-VolumesTestJSON-1090279077 tempest-VolumesTestJSON-1090279077-project-member] Calling method '.version_select at 0x7fdae1595990>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:27 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-dfff8297-9d75-434c-863d-e76d74e13e91 tempest-VolumesTestJSON-1090279077 tempest-VolumesTestJSON-1090279077-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/6025e8ca-b4bc-4de1-9a0e-1fb703752f06" status: 200 len: 351 microversion: 2.1 time: 0.061072 Apr 14 19:05:27 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 305/922] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 19:05:27 2023] GET /compute/v2.1/os-volumes/6025e8ca-b4bc-4de1-9a0e-1fb703752f06 => generated 351 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:05:28 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-07169f58-e78e-486f-bef7-e8d7d59352f1 req-a8be0337-a417-4fcb-86e3-98d751dda97f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "179270ef-7866-4ee7-af13-ec3ea5e7525a", "tag": "fef01e15-9070-4b0b-ba18-0b9540774cb9"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:05:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-07169f58-e78e-486f-bef7-e8d7d59352f1 req-a8be0337-a417-4fcb-86e3-98d751dda97f service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-07169f58-e78e-486f-bef7-e8d7d59352f1 req-a8be0337-a417-4fcb-86e3-98d751dda97f service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-07169f58-e78e-486f-bef7-e8d7d59352f1 req-a8be0337-a417-4fcb-86e3-98d751dda97f service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:28 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-07169f58-e78e-486f-bef7-e8d7d59352f1 req-a8be0337-a417-4fcb-86e3-98d751dda97f service nova] Creating event network-changed:fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance 179270ef-7866-4ee7-af13-ec3ea5e7525a on user Apr 14 19:05:28 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-07169f58-e78e-486f-bef7-e8d7d59352f1 req-a8be0337-a417-4fcb-86e3-98d751dda97f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035294 Apr 14 19:05:28 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 311/923] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:05:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:05:29 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-2624f27c-3670-4ae7-b057-d0bcde72bac9 tempest-VolumesTestJSON-1090279077 tempest-VolumesTestJSON-1090279077-project-member] Calling method '.version_select at 0x7fdae12e7400>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:29 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-2624f27c-3670-4ae7-b057-d0bcde72bac9 tempest-VolumesTestJSON-1090279077 tempest-VolumesTestJSON-1090279077-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8812e15b-dd44-48cc-ae21-56ce03062616" status: 200 len: 351 microversion: 2.1 time: 0.057642 Apr 14 19:05:29 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 308/924] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 19:05:29 2023] GET /compute/v2.1/os-volumes/8812e15b-dd44-48cc-ae21-56ce03062616 => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:05:29 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-c81950fc-32ab-4ea7-9931-91e602a4c449 tempest-VolumesTestJSON-1090279077 tempest-VolumesTestJSON-1090279077-project-member] Calling method '.version_select at 0x7fdae10364d0>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:29 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-c81950fc-32ab-4ea7-9931-91e602a4c449 tempest-VolumesTestJSON-1090279077 tempest-VolumesTestJSON-1090279077-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.161419 Apr 14 19:05:29 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 306/925] 10.0.0.210 () {62 vars in 1211 bytes} [Fri Apr 14 19:05:29 2023] GET /compute/v2.1/os-volumes => generated 1036 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:05:29 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-1cc1e58a-07d1-434d-8ff6-8ca76554168d tempest-VolumesTestJSON-1090279077 tempest-VolumesTestJSON-1090279077-project-member] Calling method '.version_select at 0x7fdae1559090>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:29 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-1cc1e58a-07d1-434d-8ff6-8ca76554168d tempest-VolumesTestJSON-1090279077 tempest-VolumesTestJSON-1090279077-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.172181 Apr 14 19:05:29 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 312/926] 10.0.0.210 () {62 vars in 1226 bytes} [Fri Apr 14 19:05:29 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:05:29 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-21335bf1-3c14-4344-9068-d1383894916c tempest-VolumesTestJSON-1090279077 tempest-VolumesTestJSON-1090279077-project-member] Calling method '.version_select at 0x7fdae0f16170>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:30 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-21335bf1-3c14-4344-9068-d1383894916c tempest-VolumesTestJSON-1090279077 tempest-VolumesTestJSON-1090279077-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.089273 Apr 14 19:05:30 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 309/927] 10.0.0.210 () {62 vars in 1211 bytes} [Fri Apr 14 19:05:29 2023] GET /compute/v2.1/os-volumes => generated 1036 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:05:30 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-90090d4a-a25e-4a90-810a-c721b90325b6 tempest-VolumesTestJSON-1090279077 tempest-VolumesTestJSON-1090279077-project-member] Calling method '.version_select at 0x7fdae1035a20>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:30 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-90090d4a-a25e-4a90-810a-c721b90325b6 tempest-VolumesTestJSON-1090279077 tempest-VolumesTestJSON-1090279077-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.115769 Apr 14 19:05:30 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 307/928] 10.0.0.210 () {62 vars in 1244 bytes} [Fri Apr 14 19:05:30 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:05:30 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-71227458-2ce7-4e27-96ee-b581f1fddb19 tempest-VolumesTestJSON-1090279077 tempest-VolumesTestJSON-1090279077-project-member] Calling method '.version_select at 0x7fdae1176050>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:30 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-71227458-2ce7-4e27-96ee-b581f1fddb19 tempest-VolumesTestJSON-1090279077 tempest-VolumesTestJSON-1090279077-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.102658 Apr 14 19:05:30 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 313/929] 10.0.0.210 () {62 vars in 1247 bytes} [Fri Apr 14 19:05:30 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:05:30 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-17bcbfb2-d191-4c59-b8ab-46467a0370ee tempest-VolumesTestJSON-1090279077 tempest-VolumesTestJSON-1090279077-project-member] Calling method '.version_select at 0x7fdae0f17250>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:30 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-17bcbfb2-d191-4c59-b8ab-46467a0370ee tempest-VolumesTestJSON-1090279077 tempest-VolumesTestJSON-1090279077-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.082352 Apr 14 19:05:30 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 310/930] 10.0.0.210 () {62 vars in 1232 bytes} [Fri Apr 14 19:05:30 2023] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:05:30 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-cfb182ac-59c8-4b99-9ea8-2eb41b0f10c4 tempest-VolumesTestJSON-1090279077 tempest-VolumesTestJSON-1090279077-project-member] Calling method '.version_select at 0x7fdae1594dc0>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:30 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-cfb182ac-59c8-4b99-9ea8-2eb41b0f10c4 tempest-VolumesTestJSON-1090279077 tempest-VolumesTestJSON-1090279077-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085221 Apr 14 19:05:30 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 308/931] 10.0.0.210 () {62 vars in 1265 bytes} [Fri Apr 14 19:05:30 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:05:30 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-3951ce23-77b4-41d0-986a-ee3c7374f0cb tempest-VolumesTestJSON-1090279077 tempest-VolumesTestJSON-1090279077-project-member] Calling method '.version_select at 0x7fdae114beb0>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:30 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-3951ce23-77b4-41d0-986a-ee3c7374f0cb tempest-VolumesTestJSON-1090279077 tempest-VolumesTestJSON-1090279077-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.090554 Apr 14 19:05:30 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 314/932] 10.0.0.210 () {62 vars in 1232 bytes} [Fri Apr 14 19:05:30 2023] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:05:32 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-373453c6-cdc7-4825-a6f0-c8c7a3c149d0 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:05:32 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-373453c6-cdc7-4825-a6f0-c8c7a3c149d0 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:05:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-373453c6-cdc7-4825-a6f0-c8c7a3c149d0 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-373453c6-cdc7-4825-a6f0-c8c7a3c149d0 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-373453c6-cdc7-4825-a6f0-c8c7a3c149d0 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-373453c6-cdc7-4825-a6f0-c8c7a3c149d0 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-373453c6-cdc7-4825-a6f0-c8c7a3c149d0 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-373453c6-cdc7-4825-a6f0-c8c7a3c149d0 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:32 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-373453c6-cdc7-4825-a6f0-c8c7a3c149d0 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468/action" status: 204 len: 0 microversion: 2.1 time: 0.148533 Apr 14 19:05:32 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 311/933] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 19:05:32 2023] POST /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468/action => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 19:05:32 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-f603e865-8cd1-416a-9c50-7e91ca1268a1 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:32 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-f603e865-8cd1-416a-9c50-7e91ca1268a1 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:05:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f603e865-8cd1-416a-9c50-7e91ca1268a1 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f603e865-8cd1-416a-9c50-7e91ca1268a1 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f603e865-8cd1-416a-9c50-7e91ca1268a1 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f603e865-8cd1-416a-9c50-7e91ca1268a1 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f603e865-8cd1-416a-9c50-7e91ca1268a1 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f603e865-8cd1-416a-9c50-7e91ca1268a1 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:33 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-f603e865-8cd1-416a-9c50-7e91ca1268a1 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:05:33 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-f603e865-8cd1-416a-9c50-7e91ca1268a1 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468" status: 200 len: 1554 microversion: 2.1 time: 0.245828 Apr 14 19:05:33 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 309/934] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:05:32 2023] GET /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468 => generated 1554 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:05:34 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-6a4f7c88-30fa-415d-be85-47f97f84d00a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:34 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-6a4f7c88-30fa-415d-be85-47f97f84d00a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:05:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6a4f7c88-30fa-415d-be85-47f97f84d00a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6a4f7c88-30fa-415d-be85-47f97f84d00a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6a4f7c88-30fa-415d-be85-47f97f84d00a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6a4f7c88-30fa-415d-be85-47f97f84d00a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6a4f7c88-30fa-415d-be85-47f97f84d00a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6a4f7c88-30fa-415d-be85-47f97f84d00a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:34 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-6a4f7c88-30fa-415d-be85-47f97f84d00a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085196 Apr 14 19:05:34 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 315/935] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 19:05:33 2023] GET /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 19:05:34 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:34 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:05:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:34 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Going to try to terminate instance {{(pid=61675) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 19:05:34 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58" status: 204 len: 0 microversion: 2.1 time: 0.125399 Apr 14 19:05:34 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 312/936] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:05:34 2023] DELETE /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 19:05:34 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-51ab7951-247e-49ab-8a3b-e968cc12860c tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:34 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-51ab7951-247e-49ab-8a3b-e968cc12860c tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:05:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-51ab7951-247e-49ab-8a3b-e968cc12860c tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-51ab7951-247e-49ab-8a3b-e968cc12860c tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-51ab7951-247e-49ab-8a3b-e968cc12860c tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-51ab7951-247e-49ab-8a3b-e968cc12860c tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-51ab7951-247e-49ab-8a3b-e968cc12860c tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-51ab7951-247e-49ab-8a3b-e968cc12860c tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:35 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-49908c9d-ed7e-46b4-a4c4-41c2247148f0 req-fc6eff52-501b-46cd-97de-e006d1b051f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05891511-e84c-4fe3-a688-edcc27849d58", "name": "network-vif-unplugged", "status": "completed", "tag": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:05:35 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-49908c9d-ed7e-46b4-a4c4-41c2247148f0 req-fc6eff52-501b-46cd-97de-e006d1b051f9 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:35 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-49908c9d-ed7e-46b4-a4c4-41c2247148f0 req-fc6eff52-501b-46cd-97de-e006d1b051f9 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:35 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-49908c9d-ed7e-46b4-a4c4-41c2247148f0 req-fc6eff52-501b-46cd-97de-e006d1b051f9 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:35 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-51ab7951-247e-49ab-8a3b-e968cc12860c tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8713ed85ffb4446847f5ded4bc2e399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60e8abd123e414f847c68ba72894689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:05:35 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=27 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:05:35 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-49908c9d-ed7e-46b4-a4c4-41c2247148f0 req-fc6eff52-501b-46cd-97de-e006d1b051f9 service nova] Creating event network-vif-unplugged:dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance 05891511-e84c-4fe3-a688-edcc27849d58 on user Apr 14 19:05:35 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-51ab7951-247e-49ab-8a3b-e968cc12860c tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58" status: 200 len: 1676 microversion: 2.1 time: 0.837069 Apr 14 19:05:35 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 310/937] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:05:34 2023] GET /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58 => generated 1676 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:05:35 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-49908c9d-ed7e-46b4-a4c4-41c2247148f0 req-fc6eff52-501b-46cd-97de-e006d1b051f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069522 Apr 14 19:05:35 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 316/938] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:05:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:05:35 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-08e509b8-330b-499b-a214-7d9055284c1d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:35 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-08e509b8-330b-499b-a214-7d9055284c1d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:05:35 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-08e509b8-330b-499b-a214-7d9055284c1d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:35 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-08e509b8-330b-499b-a214-7d9055284c1d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:35 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-08e509b8-330b-499b-a214-7d9055284c1d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:35 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-08e509b8-330b-499b-a214-7d9055284c1d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:35 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-08e509b8-330b-499b-a214-7d9055284c1d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:35 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-08e509b8-330b-499b-a214-7d9055284c1d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:36 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-08e509b8-330b-499b-a214-7d9055284c1d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10cf3683f78d4724bb734e5280e8736b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81575e6ed9bc41d2ad2ac1ad0fbd253d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:05:36 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-08e509b8-330b-499b-a214-7d9055284c1d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be" status: 200 len: 1568 microversion: 2.1 time: 0.369807 Apr 14 19:05:36 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 313/939] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:05:35 2023] GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be => generated 1568 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:05:36 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-a8aacaf1-2de4-45d0-8685-22076c7a556d req-7377bff1-9883-498f-82bd-56d76e0d1102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05891511-e84c-4fe3-a688-edcc27849d58", "name": "network-vif-deleted", "tag": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:05:36 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=15 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:05:36 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-a8aacaf1-2de4-45d0-8685-22076c7a556d req-7377bff1-9883-498f-82bd-56d76e0d1102 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:36 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-a8aacaf1-2de4-45d0-8685-22076c7a556d req-7377bff1-9883-498f-82bd-56d76e0d1102 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:36 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-a8aacaf1-2de4-45d0-8685-22076c7a556d req-7377bff1-9883-498f-82bd-56d76e0d1102 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:36 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-a8aacaf1-2de4-45d0-8685-22076c7a556d req-7377bff1-9883-498f-82bd-56d76e0d1102 service nova] Creating event network-vif-deleted:dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance 05891511-e84c-4fe3-a688-edcc27849d58 on user Apr 14 19:05:36 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-a8aacaf1-2de4-45d0-8685-22076c7a556d req-7377bff1-9883-498f-82bd-56d76e0d1102 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062127 Apr 14 19:05:36 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 311/940] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:05:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:05:37 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-28b5e9ce-b1e0-439e-917b-5d492c00149e req-44fa5749-6bba-4eda-9b23-b0255f9f39f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05891511-e84c-4fe3-a688-edcc27849d58", "name": "network-vif-plugged", "status": "completed", "tag": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:05:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-28b5e9ce-b1e0-439e-917b-5d492c00149e req-44fa5749-6bba-4eda-9b23-b0255f9f39f4 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-28b5e9ce-b1e0-439e-917b-5d492c00149e req-44fa5749-6bba-4eda-9b23-b0255f9f39f4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-28b5e9ce-b1e0-439e-917b-5d492c00149e req-44fa5749-6bba-4eda-9b23-b0255f9f39f4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:37 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-28b5e9ce-b1e0-439e-917b-5d492c00149e req-44fa5749-6bba-4eda-9b23-b0255f9f39f4 service nova] Creating event network-vif-plugged:dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance 05891511-e84c-4fe3-a688-edcc27849d58 on user Apr 14 19:05:37 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-28b5e9ce-b1e0-439e-917b-5d492c00149e req-44fa5749-6bba-4eda-9b23-b0255f9f39f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051622 Apr 14 19:05:37 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 317/941] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:05:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:05:40 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-0a7579b1-1729-49fc-8371-bf6b265e71eb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:40 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-0a7579b1-1729-49fc-8371-bf6b265e71eb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:05:40 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0a7579b1-1729-49fc-8371-bf6b265e71eb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:40 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0a7579b1-1729-49fc-8371-bf6b265e71eb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:40 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0a7579b1-1729-49fc-8371-bf6b265e71eb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:40 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0a7579b1-1729-49fc-8371-bf6b265e71eb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:40 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0a7579b1-1729-49fc-8371-bf6b265e71eb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:40 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0a7579b1-1729-49fc-8371-bf6b265e71eb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:40 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-0a7579b1-1729-49fc-8371-bf6b265e71eb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] HTTP exception thrown: Instance 23d14a51-41aa-4827-bd60-c605d9689bc8 could not be found. Apr 14 19:05:40 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-0a7579b1-1729-49fc-8371-bf6b265e71eb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Request method failure captured: Apr 14 19:05:40 user devstack@n-api.service[61675]: request: GET /compute/v2.1/servers/23d14a51-41aa-4827-bd60-c605d9689bc8 HTTP/1.1 Apr 14 19:05:40 user devstack@n-api.service[61675]: Accept: application/json Apr 14 19:05:40 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 19:05:40 user devstack@n-api.service[61675]: Connection: close Apr 14 19:05:40 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 19:05:40 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 19:05:40 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 19:05:40 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 19:05:40 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 19:05:40 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOZ9nnPCXT2QdXSPWwVlCjp7pyXFpgrlAX-vfX50Qxai2B6k6Sv9Eh_PLls3HRJrj-Jv-x2WsQVnktQmvPcAus0yc32hEM2J2lZCmpZH6vf8f7he9r8FkKysH7AamOkQjdnbmnS_op_MrAg4cU3dqmaIghoDPfOx6PuY0hLvr2DGIzJg Apr 14 19:05:40 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 19:05:40 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 19:05:40 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 19:05:40 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 19:05:40 user devstack@n-api.service[61675]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 19:05:40 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 19:05:40 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 19:05:40 user devstack@n-api.service[61675]: X-Project-Id: 424e732759884efa8fd126cd9a082c8a Apr 14 19:05:40 user devstack@n-api.service[61675]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1815450365 Apr 14 19:05:40 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 19:05:40 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 19:05:40 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/424e732759884efa8fd126cd9a082c8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/424e732759884efa8fd126cd9a082c8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/424e732759884efa8fd126cd9a082c8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:05:40 user devstack@n-api.service[61675]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1815450365 Apr 14 19:05:40 user devstack@n-api.service[61675]: X-Tenant-Id: 424e732759884efa8fd126cd9a082c8a Apr 14 19:05:40 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1815450365 Apr 14 19:05:40 user devstack@n-api.service[61675]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member Apr 14 19:05:40 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 19:05:40 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 19:05:40 user devstack@n-api.service[61675]: X-User-Id: a644b8bb9b90494ba670da8315bfe005 Apr 14 19:05:40 user devstack@n-api.service[61675]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member Apr 14 19:05:40 user devstack@n-api.service[61675]: method: > Apr 14 19:05:40 user devstack@n-api.service[61675]: exception: Instance 23d14a51-41aa-4827-bd60-c605d9689bc8 could not be found. Apr 14 19:05:40 user devstack@n-api.service[61675]: action_args: {'id': '23d14a51-41aa-4827-bd60-c605d9689bc8'} Apr 14 19:05:40 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23d14a51-41aa-4827-bd60-c605d9689bc8 could not be found. Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23d14a51-41aa-4827-bd60-c605d9689bc8 could not be found. Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23d14a51-41aa-4827-bd60-c605d9689bc8 could not be found. Apr 14 19:05:40 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:05:40 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-0a7579b1-1729-49fc-8371-bf6b265e71eb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Returning 404 to user: Instance 23d14a51-41aa-4827-bd60-c605d9689bc8 could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:05:40 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-0a7579b1-1729-49fc-8371-bf6b265e71eb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23d14a51-41aa-4827-bd60-c605d9689bc8" status: 404 len: 111 microversion: 2.87 time: 0.030256 Apr 14 19:05:40 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 314/942] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:05:40 2023] GET /compute/v2.1/servers/23d14a51-41aa-4827-bd60-c605d9689bc8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 19:05:40 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:40 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:05:40 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:40 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:40 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:40 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:40 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:40 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:40 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Going to try to terminate instance {{(pid=61673) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 19:05:40 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" status: 204 len: 0 microversion: 2.87 time: 0.137411 Apr 14 19:05:40 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 312/943] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 19:05:40 2023] DELETE /compute/v2.1/servers/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 19:05:40 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-042f560b-6d33-447d-8a17-38bf23b55019 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:05:40 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-042f560b-6d33-447d-8a17-38bf23b55019 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:05:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-042f560b-6d33-447d-8a17-38bf23b55019 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-042f560b-6d33-447d-8a17-38bf23b55019 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-042f560b-6d33-447d-8a17-38bf23b55019 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-042f560b-6d33-447d-8a17-38bf23b55019 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-042f560b-6d33-447d-8a17-38bf23b55019 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-042f560b-6d33-447d-8a17-38bf23b55019 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:40 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-c0312f4f-894e-4b1e-b534-e9943d29367d req-9eef3748-b26a-49ab-8fc7-0cd5439e1120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6", "name": "network-vif-unplugged", "status": "completed", "tag": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:05:40 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-c0312f4f-894e-4b1e-b534-e9943d29367d req-9eef3748-b26a-49ab-8fc7-0cd5439e1120 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:40 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-c0312f4f-894e-4b1e-b534-e9943d29367d req-9eef3748-b26a-49ab-8fc7-0cd5439e1120 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:40 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-c0312f4f-894e-4b1e-b534-e9943d29367d req-9eef3748-b26a-49ab-8fc7-0cd5439e1120 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:40 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-c0312f4f-894e-4b1e-b534-e9943d29367d req-9eef3748-b26a-49ab-8fc7-0cd5439e1120 service nova] Creating event network-vif-unplugged:99d9a465-1b2a-40bf-aafb-56e1a58ca1ed for instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 on user Apr 14 19:05:40 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-c0312f4f-894e-4b1e-b534-e9943d29367d req-9eef3748-b26a-49ab-8fc7-0cd5439e1120 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051599 Apr 14 19:05:40 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 315/944] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:05:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:05:40 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-042f560b-6d33-447d-8a17-38bf23b55019 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:05:40 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-042f560b-6d33-447d-8a17-38bf23b55019 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:05:40 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-042f560b-6d33-447d-8a17-38bf23b55019 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:05:40 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-042f560b-6d33-447d-8a17-38bf23b55019 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" status: 200 len: 1696 microversion: 2.87 time: 0.484909 Apr 14 19:05:40 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 318/945] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:05:40 2023] GET /compute/v2.1/servers/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 => generated 1696 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 19:05:40 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-f47e5843-afc0-48b6-a4b9-19ce9740e7c1 req-be483b49-9cd5-41dd-8d91-4de729e0edb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9379580-fd2f-4468-9ed3-7109735195be", "tag": "f22a5e1e-5aed-419f-aa06-308984681fbc"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:05:40 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-f47e5843-afc0-48b6-a4b9-19ce9740e7c1 req-be483b49-9cd5-41dd-8d91-4de729e0edb9 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:40 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-f47e5843-afc0-48b6-a4b9-19ce9740e7c1 req-be483b49-9cd5-41dd-8d91-4de729e0edb9 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:40 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-f47e5843-afc0-48b6-a4b9-19ce9740e7c1 req-be483b49-9cd5-41dd-8d91-4de729e0edb9 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:41 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-f47e5843-afc0-48b6-a4b9-19ce9740e7c1 req-be483b49-9cd5-41dd-8d91-4de729e0edb9 service nova] Creating event network-changed:f22a5e1e-5aed-419f-aa06-308984681fbc for instance a9379580-fd2f-4468-9ed3-7109735195be on user Apr 14 19:05:41 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-f47e5843-afc0-48b6-a4b9-19ce9740e7c1 req-be483b49-9cd5-41dd-8d91-4de729e0edb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032658 Apr 14 19:05:41 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 313/946] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:05:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:05:41 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57840ae0-4cce-45c4-82e7-6942f8812b4a"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:05:41 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:05:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:41 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.366313 Apr 14 19:05:41 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 316/947] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 19:05:41 2023] POST /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments => generated 194 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:05:42 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-bb399d79-ab4f-4053-91ae-dd02afe4fc8f req-1bcac64a-be8c-4fe3-9c38-26dc39d6ea9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6", "name": "network-vif-plugged", "status": "completed", "tag": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:05:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-bb399d79-ab4f-4053-91ae-dd02afe4fc8f req-1bcac64a-be8c-4fe3-9c38-26dc39d6ea9f service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-bb399d79-ab4f-4053-91ae-dd02afe4fc8f req-1bcac64a-be8c-4fe3-9c38-26dc39d6ea9f service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:42 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-bb399d79-ab4f-4053-91ae-dd02afe4fc8f req-1bcac64a-be8c-4fe3-9c38-26dc39d6ea9f service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:42 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-bb399d79-ab4f-4053-91ae-dd02afe4fc8f req-1bcac64a-be8c-4fe3-9c38-26dc39d6ea9f service nova] Creating event network-vif-plugged:99d9a465-1b2a-40bf-aafb-56e1a58ca1ed for instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 on user Apr 14 19:05:42 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-bb399d79-ab4f-4053-91ae-dd02afe4fc8f req-1bcac64a-be8c-4fe3-9c38-26dc39d6ea9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031681 Apr 14 19:05:42 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 319/948] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:05:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:05:43 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-bf30f00d-8996-4607-b3de-c0b413309865 req-7cfcd609-a8cd-4cd0-91fa-b0c90b0ca85b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6", "name": "network-vif-deleted", "tag": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:05:43 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-bf30f00d-8996-4607-b3de-c0b413309865 req-7cfcd609-a8cd-4cd0-91fa-b0c90b0ca85b service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:05:43 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-bf30f00d-8996-4607-b3de-c0b413309865 req-7cfcd609-a8cd-4cd0-91fa-b0c90b0ca85b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:05:43 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-bf30f00d-8996-4607-b3de-c0b413309865 req-7cfcd609-a8cd-4cd0-91fa-b0c90b0ca85b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:05:43 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-bf30f00d-8996-4607-b3de-c0b413309865 req-7cfcd609-a8cd-4cd0-91fa-b0c90b0ca85b service nova] Creating event network-vif-deleted:99d9a465-1b2a-40bf-aafb-56e1a58ca1ed for instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 on user Apr 14 19:05:43 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-bf30f00d-8996-4607-b3de-c0b413309865 req-7cfcd609-a8cd-4cd0-91fa-b0c90b0ca85b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034508 Apr 14 19:05:43 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 314/949] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:05:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:06:00 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:06:00 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:06:00 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:06:00 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:06:00 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:00 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:00 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:00 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:00 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:00 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:01 user devstack@n-api.service[61675]: DEBUG nova.objects.instance [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lazy-loading 'services' on Instance uuid a9379580-fd2f-4468-9ed3-7109735195be {{(pid=61675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 19:06:01 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments/57840ae0-4cce-45c4-82e7-6942f8812b4a" status: 202 len: 0 microversion: 2.1 time: 0.606587 Apr 14 19:06:01 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 317/950] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 19:06:00 2023] DELETE /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments/57840ae0-4cce-45c4-82e7-6942f8812b4a => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 19:06:01 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=20 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:06:01 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:06:01 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-0d66b2a5-844e-410f-904d-e26c7bee3898 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:06:01 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-0d66b2a5-844e-410f-904d-e26c7bee3898 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:06:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-0d66b2a5-844e-410f-904d-e26c7bee3898 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-0d66b2a5-844e-410f-904d-e26c7bee3898 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-0d66b2a5-844e-410f-904d-e26c7bee3898 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-0d66b2a5-844e-410f-904d-e26c7bee3898 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-0d66b2a5-844e-410f-904d-e26c7bee3898 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:01 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-0d66b2a5-844e-410f-904d-e26c7bee3898 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:01 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-0d66b2a5-844e-410f-904d-e26c7bee3898 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062135 Apr 14 19:06:01 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 320/951] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 19:06:01 2023] GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:06:13 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:06:13 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:06:13 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-aa2baa06-becb-4482-ade5-2d87aaa7f322 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:06:13 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-aa2baa06-becb-4482-ade5-2d87aaa7f322 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:06:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-aa2baa06-becb-4482-ade5-2d87aaa7f322 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-aa2baa06-becb-4482-ade5-2d87aaa7f322 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-aa2baa06-becb-4482-ade5-2d87aaa7f322 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-aa2baa06-becb-4482-ade5-2d87aaa7f322 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-aa2baa06-becb-4482-ade5-2d87aaa7f322 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-aa2baa06-becb-4482-ade5-2d87aaa7f322 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:13 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-aa2baa06-becb-4482-ade5-2d87aaa7f322 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:06:13 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-aa2baa06-becb-4482-ade5-2d87aaa7f322 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:06:13 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-aa2baa06-becb-4482-ade5-2d87aaa7f322 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:06:13 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-aa2baa06-becb-4482-ade5-2d87aaa7f322 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a" status: 200 len: 1653 microversion: 2.20 time: 0.271536 Apr 14 19:06:13 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 315/952] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:06:13 2023] GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a => generated 1653 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 19:06:16 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:06:16 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:06:16 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-51040094-5b64-498b-b64f-26cba7a6ba32 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:06:16 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-51040094-5b64-498b-b64f-26cba7a6ba32 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:06:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-51040094-5b64-498b-b64f-26cba7a6ba32 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-51040094-5b64-498b-b64f-26cba7a6ba32 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-51040094-5b64-498b-b64f-26cba7a6ba32 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-51040094-5b64-498b-b64f-26cba7a6ba32 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-51040094-5b64-498b-b64f-26cba7a6ba32 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-51040094-5b64-498b-b64f-26cba7a6ba32 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:16 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-51040094-5b64-498b-b64f-26cba7a6ba32 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:06:16 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-51040094-5b64-498b-b64f-26cba7a6ba32 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3fde6b1-ddc9-400e-a032-f80cd32bad39" status: 200 len: 1439 microversion: 2.1 time: 0.454770 Apr 14 19:06:16 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 318/953] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:06:16 2023] GET /compute/v2.1/servers/f3fde6b1-ddc9-400e-a032-f80cd32bad39 => generated 1439 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:06:18 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-53156946-7cc8-40b7-8cbd-9088449b7b91 req-4796c598-32bf-4b22-8399-d1b68f317dcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3fde6b1-ddc9-400e-a032-f80cd32bad39", "tag": "7527e5c9-4845-43dd-970d-b0072b4c0639"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:06:18 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:06:18 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=6 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:06:18 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-53156946-7cc8-40b7-8cbd-9088449b7b91 req-4796c598-32bf-4b22-8399-d1b68f317dcf service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:18 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-53156946-7cc8-40b7-8cbd-9088449b7b91 req-4796c598-32bf-4b22-8399-d1b68f317dcf service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:18 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-53156946-7cc8-40b7-8cbd-9088449b7b91 req-4796c598-32bf-4b22-8399-d1b68f317dcf service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:18 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-53156946-7cc8-40b7-8cbd-9088449b7b91 req-4796c598-32bf-4b22-8399-d1b68f317dcf service nova] Creating event network-changed:7527e5c9-4845-43dd-970d-b0072b4c0639 for instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 on user Apr 14 19:06:18 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-53156946-7cc8-40b7-8cbd-9088449b7b91 req-4796c598-32bf-4b22-8399-d1b68f317dcf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038321 Apr 14 19:06:18 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 321/954] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:06:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:06:19 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:06:19 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:06:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:19 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Going to try to terminate instance {{(pid=61673) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 19:06:19 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f3fde6b1-ddc9-400e-a032-f80cd32bad39" status: 204 len: 0 microversion: 2.1 time: 0.124320 Apr 14 19:06:19 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 316/955] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:06:19 2023] DELETE /compute/v2.1/servers/f3fde6b1-ddc9-400e-a032-f80cd32bad39 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 19:06:19 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-ce2ccecf-3f1d-4996-91ab-bcd46a150d2f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:06:19 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-ce2ccecf-3f1d-4996-91ab-bcd46a150d2f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:06:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ce2ccecf-3f1d-4996-91ab-bcd46a150d2f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ce2ccecf-3f1d-4996-91ab-bcd46a150d2f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ce2ccecf-3f1d-4996-91ab-bcd46a150d2f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ce2ccecf-3f1d-4996-91ab-bcd46a150d2f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ce2ccecf-3f1d-4996-91ab-bcd46a150d2f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ce2ccecf-3f1d-4996-91ab-bcd46a150d2f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:19 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-ce2ccecf-3f1d-4996-91ab-bcd46a150d2f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:06:19 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-ce2ccecf-3f1d-4996-91ab-bcd46a150d2f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3fde6b1-ddc9-400e-a032-f80cd32bad39" status: 200 len: 1445 microversion: 2.1 time: 0.234061 Apr 14 19:06:19 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 319/956] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:06:19 2023] GET /compute/v2.1/servers/f3fde6b1-ddc9-400e-a032-f80cd32bad39 => generated 1445 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:06:19 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-457db887-ae30-445d-b3fe-a95ad884b870 req-5704df2a-6984-4d40-98db-e4cd10bd7a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fde6b1-ddc9-400e-a032-f80cd32bad39", "name": "network-vif-unplugged", "status": "completed", "tag": "7527e5c9-4845-43dd-970d-b0072b4c0639"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:06:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-457db887-ae30-445d-b3fe-a95ad884b870 req-5704df2a-6984-4d40-98db-e4cd10bd7a1e service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-457db887-ae30-445d-b3fe-a95ad884b870 req-5704df2a-6984-4d40-98db-e4cd10bd7a1e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:19 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-457db887-ae30-445d-b3fe-a95ad884b870 req-5704df2a-6984-4d40-98db-e4cd10bd7a1e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:19 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-457db887-ae30-445d-b3fe-a95ad884b870 req-5704df2a-6984-4d40-98db-e4cd10bd7a1e service nova] Creating event network-vif-unplugged:7527e5c9-4845-43dd-970d-b0072b4c0639 for instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 on user Apr 14 19:06:19 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-457db887-ae30-445d-b3fe-a95ad884b870 req-5704df2a-6984-4d40-98db-e4cd10bd7a1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038756 Apr 14 19:06:19 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 322/957] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:06:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:06:22 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-9dc00262-2291-44e4-8434-6c518592fc63 req-b02411d2-3369-4192-b472-0c6c1b8ec6be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fde6b1-ddc9-400e-a032-f80cd32bad39", "name": "network-vif-plugged", "status": "completed", "tag": "7527e5c9-4845-43dd-970d-b0072b4c0639"}, {"server_uuid": "f3fde6b1-ddc9-400e-a032-f80cd32bad39", "name": "network-vif-deleted", "tag": "7527e5c9-4845-43dd-970d-b0072b4c0639"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:06:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9dc00262-2291-44e4-8434-6c518592fc63 req-b02411d2-3369-4192-b472-0c6c1b8ec6be service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9dc00262-2291-44e4-8434-6c518592fc63 req-b02411d2-3369-4192-b472-0c6c1b8ec6be service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9dc00262-2291-44e4-8434-6c518592fc63 req-b02411d2-3369-4192-b472-0c6c1b8ec6be service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:22 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-9dc00262-2291-44e4-8434-6c518592fc63 req-b02411d2-3369-4192-b472-0c6c1b8ec6be service nova] Creating event network-vif-plugged:7527e5c9-4845-43dd-970d-b0072b4c0639 for instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 on user Apr 14 19:06:22 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-9dc00262-2291-44e4-8434-6c518592fc63 req-b02411d2-3369-4192-b472-0c6c1b8ec6be service nova] Creating event network-vif-deleted:7527e5c9-4845-43dd-970d-b0072b4c0639 for instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 on user Apr 14 19:06:22 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-9dc00262-2291-44e4-8434-6c518592fc63 req-b02411d2-3369-4192-b472-0c6c1b8ec6be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033160 Apr 14 19:06:22 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 317/958] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:06:22 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:06:23 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-da8117bf-b9e4-4495-ad63-f36cc7a8470e tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:06:23 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-da8117bf-b9e4-4495-ad63-f36cc7a8470e tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:06:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-da8117bf-b9e4-4495-ad63-f36cc7a8470e tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-da8117bf-b9e4-4495-ad63-f36cc7a8470e tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-da8117bf-b9e4-4495-ad63-f36cc7a8470e tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-da8117bf-b9e4-4495-ad63-f36cc7a8470e tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-da8117bf-b9e4-4495-ad63-f36cc7a8470e tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-da8117bf-b9e4-4495-ad63-f36cc7a8470e tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:23 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-da8117bf-b9e4-4495-ad63-f36cc7a8470e tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:06:23 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-da8117bf-b9e4-4495-ad63-f36cc7a8470e tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468" status: 200 len: 1546 microversion: 2.1 time: 0.259581 Apr 14 19:06:23 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 320/959] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:06:23 2023] GET /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468 => generated 1546 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:06:25 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-4d834ae3-a3ff-4221-ab7d-cd1d35e14a2b tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:06:25 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-4d834ae3-a3ff-4221-ab7d-cd1d35e14a2b tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:06:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4d834ae3-a3ff-4221-ab7d-cd1d35e14a2b tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4d834ae3-a3ff-4221-ab7d-cd1d35e14a2b tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4d834ae3-a3ff-4221-ab7d-cd1d35e14a2b tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4d834ae3-a3ff-4221-ab7d-cd1d35e14a2b tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4d834ae3-a3ff-4221-ab7d-cd1d35e14a2b tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4d834ae3-a3ff-4221-ab7d-cd1d35e14a2b tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:25 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-4d834ae3-a3ff-4221-ab7d-cd1d35e14a2b tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] HTTP exception thrown: Instance 05891511-e84c-4fe3-a688-edcc27849d58 could not be found. Apr 14 19:06:25 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-4d834ae3-a3ff-4221-ab7d-cd1d35e14a2b tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Request method failure captured: Apr 14 19:06:25 user devstack@n-api.service[61674]: request: GET /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58 HTTP/1.1 Apr 14 19:06:25 user devstack@n-api.service[61674]: Accept: application/json Apr 14 19:06:25 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 19:06:25 user devstack@n-api.service[61674]: Connection: close Apr 14 19:06:25 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 19:06:25 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 19:06:25 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 19:06:25 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 19:06:25 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 19:06:25 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOaBsVI_nvkyYSUnUpk_9LZivhBf1YZK5uRUFFR2iv7YLDTugI5hWoRijQ-9F1cI4hDuKdzxQWbf2lUpXfxiTO1q10jdi5iIMybz9kkHtzg_mWEjrwYVtbLI2p_4_sZODWdXkFWOQ0NLBMotwKrDrF_4nfgQcIHiwUOtMf5a-BxmB6jA Apr 14 19:06:25 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 19:06:25 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 19:06:25 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 19:06:25 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 19:06:25 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 19:06:25 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 19:06:25 user devstack@n-api.service[61674]: X-Project-Id: e60e8abd123e414f847c68ba72894689 Apr 14 19:06:25 user devstack@n-api.service[61674]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1174646715 Apr 14 19:06:25 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 19:06:25 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 19:06:25 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e60e8abd123e414f847c68ba72894689"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e60e8abd123e414f847c68ba72894689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e60e8abd123e414f847c68ba72894689"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:06:25 user devstack@n-api.service[61674]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1174646715 Apr 14 19:06:25 user devstack@n-api.service[61674]: X-Tenant-Id: e60e8abd123e414f847c68ba72894689 Apr 14 19:06:25 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1174646715 Apr 14 19:06:25 user devstack@n-api.service[61674]: X-User: tempest-ServerRescueNegativeTestJSON-1174646715-project-member Apr 14 19:06:25 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 19:06:25 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 19:06:25 user devstack@n-api.service[61674]: X-User-Id: c8713ed85ffb4446847f5ded4bc2e399 Apr 14 19:06:25 user devstack@n-api.service[61674]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1174646715-project-member Apr 14 19:06:25 user devstack@n-api.service[61674]: method: > Apr 14 19:06:25 user devstack@n-api.service[61674]: exception: Instance 05891511-e84c-4fe3-a688-edcc27849d58 could not be found. Apr 14 19:06:25 user devstack@n-api.service[61674]: action_args: {'id': '05891511-e84c-4fe3-a688-edcc27849d58'} Apr 14 19:06:25 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05891511-e84c-4fe3-a688-edcc27849d58 could not be found. Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05891511-e84c-4fe3-a688-edcc27849d58 could not be found. Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05891511-e84c-4fe3-a688-edcc27849d58 could not be found. Apr 14 19:06:25 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:06:25 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-4d834ae3-a3ff-4221-ab7d-cd1d35e14a2b tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Returning 404 to user: Instance 05891511-e84c-4fe3-a688-edcc27849d58 could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:06:25 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-4d834ae3-a3ff-4221-ab7d-cd1d35e14a2b tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58" status: 404 len: 111 microversion: 2.1 time: 0.147310 Apr 14 19:06:25 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 323/960] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:06:25 2023] GET /compute/v2.1/servers/05891511-e84c-4fe3-a688-edcc27849d58 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:06:25 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-9f81e840-cd53-4ac0-976b-fefd3e4de58d tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '.version_select at 0x7fdae10a37f0>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:06:25 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-9f81e840-cd53-4ac0-976b-fefd3e4de58d tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-126127202" status: 202 len: 0 microversion: 2.1 time: 0.024622 Apr 14 19:06:25 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 318/961] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 19:06:25 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-126127202 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 19:06:31 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-8a9b8bcf-e17a-4860-8092-77842dc88d6b tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:06:31 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-8a9b8bcf-e17a-4860-8092-77842dc88d6b tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:06:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8a9b8bcf-e17a-4860-8092-77842dc88d6b tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8a9b8bcf-e17a-4860-8092-77842dc88d6b tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8a9b8bcf-e17a-4860-8092-77842dc88d6b tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8a9b8bcf-e17a-4860-8092-77842dc88d6b tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8a9b8bcf-e17a-4860-8092-77842dc88d6b tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8a9b8bcf-e17a-4860-8092-77842dc88d6b tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:31 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-8a9b8bcf-e17a-4860-8092-77842dc88d6b tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] HTTP exception thrown: Instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 could not be found. Apr 14 19:06:31 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-8a9b8bcf-e17a-4860-8092-77842dc88d6b tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Request method failure captured: Apr 14 19:06:31 user devstack@n-api.service[61675]: request: GET /compute/v2.1/servers/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 HTTP/1.1 Apr 14 19:06:31 user devstack@n-api.service[61675]: Accept: application/json Apr 14 19:06:31 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 19:06:31 user devstack@n-api.service[61675]: Connection: close Apr 14 19:06:31 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 19:06:31 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 19:06:31 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 19:06:31 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 19:06:31 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 19:06:31 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOZ9nnPCXT2QdXSPWwVlCjp7pyXFpgrlAX-vfX50Qxai2B6k6Sv9Eh_PLls3HRJrj-Jv-x2WsQVnktQmvPcAus0yc32hEM2J2lZCmpZH6vf8f7he9r8FkKysH7AamOkQjdnbmnS_op_MrAg4cU3dqmaIghoDPfOx6PuY0hLvr2DGIzJg Apr 14 19:06:31 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 19:06:31 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 19:06:31 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 19:06:31 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 19:06:31 user devstack@n-api.service[61675]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 19:06:31 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 19:06:31 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 19:06:31 user devstack@n-api.service[61675]: X-Project-Id: 424e732759884efa8fd126cd9a082c8a Apr 14 19:06:31 user devstack@n-api.service[61675]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1815450365 Apr 14 19:06:31 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 19:06:31 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 19:06:31 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/424e732759884efa8fd126cd9a082c8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/424e732759884efa8fd126cd9a082c8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/424e732759884efa8fd126cd9a082c8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:06:31 user devstack@n-api.service[61675]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1815450365 Apr 14 19:06:31 user devstack@n-api.service[61675]: X-Tenant-Id: 424e732759884efa8fd126cd9a082c8a Apr 14 19:06:31 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1815450365 Apr 14 19:06:31 user devstack@n-api.service[61675]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member Apr 14 19:06:31 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 19:06:31 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 19:06:31 user devstack@n-api.service[61675]: X-User-Id: a644b8bb9b90494ba670da8315bfe005 Apr 14 19:06:31 user devstack@n-api.service[61675]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member Apr 14 19:06:31 user devstack@n-api.service[61675]: method: > Apr 14 19:06:31 user devstack@n-api.service[61675]: exception: Instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 could not be found. Apr 14 19:06:31 user devstack@n-api.service[61675]: action_args: {'id': '89d05353-f3a2-467d-9f7f-e0da1f0c4cc6'} Apr 14 19:06:31 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 could not be found. Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 could not be found. Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 could not be found. Apr 14 19:06:31 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:06:31 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-8a9b8bcf-e17a-4860-8092-77842dc88d6b tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Returning 404 to user: Instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:06:31 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-8a9b8bcf-e17a-4860-8092-77842dc88d6b tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" status: 404 len: 111 microversion: 2.87 time: 0.030322 Apr 14 19:06:31 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 321/962] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:06:31 2023] GET /compute/v2.1/servers/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 19:06:34 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:06:34 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:06:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:34 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:34 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Going to try to terminate instance {{(pid=61674) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 19:06:34 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cf640f3e-3d77-46ee-8a11-e0bdc870ff97" status: 204 len: 0 microversion: 2.1 time: 0.132387 Apr 14 19:06:34 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 324/963] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:06:34 2023] DELETE /compute/v2.1/servers/cf640f3e-3d77-46ee-8a11-e0bdc870ff97 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 19:06:34 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:06:34 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-28b77fbb-1c70-431d-ad35-30d828b4dcb6 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:06:34 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-28b77fbb-1c70-431d-ad35-30d828b4dcb6 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:06:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-28b77fbb-1c70-431d-ad35-30d828b4dcb6 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-28b77fbb-1c70-431d-ad35-30d828b4dcb6 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-28b77fbb-1c70-431d-ad35-30d828b4dcb6 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-28b77fbb-1c70-431d-ad35-30d828b4dcb6 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-28b77fbb-1c70-431d-ad35-30d828b4dcb6 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:34 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-28b77fbb-1c70-431d-ad35-30d828b4dcb6 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:35 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-a9f2faa5-3d12-4266-b9ee-ae285c69acca req-1a5f17f0-e261-476c-a157-389a7e456f89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf640f3e-3d77-46ee-8a11-e0bdc870ff97", "name": "network-vif-unplugged", "status": "completed", "tag": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:06:35 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-a9f2faa5-3d12-4266-b9ee-ae285c69acca req-1a5f17f0-e261-476c-a157-389a7e456f89 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:35 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-a9f2faa5-3d12-4266-b9ee-ae285c69acca req-1a5f17f0-e261-476c-a157-389a7e456f89 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:35 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-a9f2faa5-3d12-4266-b9ee-ae285c69acca req-1a5f17f0-e261-476c-a157-389a7e456f89 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:35 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-a9f2faa5-3d12-4266-b9ee-ae285c69acca req-1a5f17f0-e261-476c-a157-389a7e456f89 service nova] Creating event network-vif-unplugged:ee0e2f74-c744-41ec-b3f8-c7d124c61f8e for instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 on user Apr 14 19:06:35 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-a9f2faa5-3d12-4266-b9ee-ae285c69acca req-1a5f17f0-e261-476c-a157-389a7e456f89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072481 Apr 14 19:06:35 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 322/964] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:06:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:06:35 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-28b77fbb-1c70-431d-ad35-30d828b4dcb6 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8713ed85ffb4446847f5ded4bc2e399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60e8abd123e414f847c68ba72894689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:06:35 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-28b77fbb-1c70-431d-ad35-30d828b4dcb6 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf640f3e-3d77-46ee-8a11-e0bdc870ff97" status: 200 len: 1495 microversion: 2.1 time: 0.424209 Apr 14 19:06:35 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 319/965] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:06:34 2023] GET /compute/v2.1/servers/cf640f3e-3d77-46ee-8a11-e0bdc870ff97 => generated 1495 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:06:36 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-9be85ce1-f947-4252-a423-4435b5ecd1e2 tempest-VolumesGetTestJSON-1251262402 tempest-VolumesGetTestJSON-1251262402-project-member] Action: 'create', calling method: .version_select at 0x7fdae11775b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-826515864", "metadata": {"Type": "work"}}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:06:36 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-9be85ce1-f947-4252-a423-4435b5ecd1e2 tempest-VolumesGetTestJSON-1251262402 tempest-VolumesGetTestJSON-1251262402-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.746549 Apr 14 19:06:36 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 325/966] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 19:06:36 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 748 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 14 19:06:36 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-af00e512-70a2-4d9f-a795-cf3a43c233a2 tempest-VolumesGetTestJSON-1251262402 tempest-VolumesGetTestJSON-1251262402-project-member] Calling method '.version_select at 0x7fdae1599f30>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:06:36 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-08588a85-efe7-4b8c-8fbe-d0c9b27ef738 req-0f2a8323-ef49-443d-aa7b-920908d86f8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf640f3e-3d77-46ee-8a11-e0bdc870ff97", "name": "network-vif-deleted", "tag": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:06:36 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-08588a85-efe7-4b8c-8fbe-d0c9b27ef738 req-0f2a8323-ef49-443d-aa7b-920908d86f8c service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:36 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-08588a85-efe7-4b8c-8fbe-d0c9b27ef738 req-0f2a8323-ef49-443d-aa7b-920908d86f8c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:36 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-08588a85-efe7-4b8c-8fbe-d0c9b27ef738 req-0f2a8323-ef49-443d-aa7b-920908d86f8c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:37 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-af00e512-70a2-4d9f-a795-cf3a43c233a2 tempest-VolumesGetTestJSON-1251262402 tempest-VolumesGetTestJSON-1251262402-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8669788b-4a6c-4970-a59a-ac2c1108bbfe" status: 200 len: 352 microversion: 2.1 time: 0.132409 Apr 14 19:06:37 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 323/967] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 19:06:36 2023] GET /compute/v2.1/os-volumes/8669788b-4a6c-4970-a59a-ac2c1108bbfe => generated 352 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:06:37 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-08588a85-efe7-4b8c-8fbe-d0c9b27ef738 req-0f2a8323-ef49-443d-aa7b-920908d86f8c service nova] Creating event network-vif-deleted:ee0e2f74-c744-41ec-b3f8-c7d124c61f8e for instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 on user Apr 14 19:06:37 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-08588a85-efe7-4b8c-8fbe-d0c9b27ef738 req-0f2a8323-ef49-443d-aa7b-920908d86f8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144927 Apr 14 19:06:37 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 320/968] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:06:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:06:37 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-6037a156-1502-4dcc-a70e-54a4b101b4ad req-73f988ee-ddd3-49cd-a4b3-d7b79396402f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf640f3e-3d77-46ee-8a11-e0bdc870ff97", "name": "network-vif-plugged", "status": "completed", "tag": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:06:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6037a156-1502-4dcc-a70e-54a4b101b4ad req-73f988ee-ddd3-49cd-a4b3-d7b79396402f service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6037a156-1502-4dcc-a70e-54a4b101b4ad req-73f988ee-ddd3-49cd-a4b3-d7b79396402f service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6037a156-1502-4dcc-a70e-54a4b101b4ad req-73f988ee-ddd3-49cd-a4b3-d7b79396402f service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:37 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-6037a156-1502-4dcc-a70e-54a4b101b4ad req-73f988ee-ddd3-49cd-a4b3-d7b79396402f service nova] Creating event network-vif-plugged:ee0e2f74-c744-41ec-b3f8-c7d124c61f8e for instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 on user Apr 14 19:06:37 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-6037a156-1502-4dcc-a70e-54a4b101b4ad req-73f988ee-ddd3-49cd-a4b3-d7b79396402f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042902 Apr 14 19:06:37 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 326/969] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:06:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:06:38 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-4767ab72-29aa-4f18-b9d3-ccfc78ad7b24 tempest-VolumesGetTestJSON-1251262402 tempest-VolumesGetTestJSON-1251262402-project-member] Calling method '.version_select at 0x7fdae159a830>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:06:38 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-4767ab72-29aa-4f18-b9d3-ccfc78ad7b24 tempest-VolumesGetTestJSON-1251262402 tempest-VolumesGetTestJSON-1251262402-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8669788b-4a6c-4970-a59a-ac2c1108bbfe" status: 200 len: 352 microversion: 2.1 time: 0.064399 Apr 14 19:06:38 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 324/970] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 19:06:38 2023] GET /compute/v2.1/os-volumes/8669788b-4a6c-4970-a59a-ac2c1108bbfe => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:06:39 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-09df5664-37bf-4a0d-a62c-9e3234253c32 tempest-VolumesGetTestJSON-1251262402 tempest-VolumesGetTestJSON-1251262402-project-member] Calling method '.version_select at 0x7fdae15979a0>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:06:39 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-09df5664-37bf-4a0d-a62c-9e3234253c32 tempest-VolumesGetTestJSON-1251262402 tempest-VolumesGetTestJSON-1251262402-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8669788b-4a6c-4970-a59a-ac2c1108bbfe" status: 200 len: 353 microversion: 2.1 time: 0.068694 Apr 14 19:06:39 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 321/971] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 19:06:39 2023] GET /compute/v2.1/os-volumes/8669788b-4a6c-4970-a59a-ac2c1108bbfe => generated 353 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:06:39 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-bab9a453-07f2-4397-ab05-c6bdcf2a4637 tempest-VolumesGetTestJSON-1251262402 tempest-VolumesGetTestJSON-1251262402-project-member] Calling method '.version_select at 0x7fdae1174670>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:06:39 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-bab9a453-07f2-4397-ab05-c6bdcf2a4637 tempest-VolumesGetTestJSON-1251262402 tempest-VolumesGetTestJSON-1251262402-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8669788b-4a6c-4970-a59a-ac2c1108bbfe" status: 200 len: 353 microversion: 2.1 time: 0.057745 Apr 14 19:06:39 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 327/972] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 19:06:39 2023] GET /compute/v2.1/os-volumes/8669788b-4a6c-4970-a59a-ac2c1108bbfe => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:06:39 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-40001357-0761-42da-a5d0-cb73327a07c0 tempest-VolumesGetTestJSON-1251262402 tempest-VolumesGetTestJSON-1251262402-project-member] Calling method '.version_select at 0x7fdae159bb50>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:06:39 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-40001357-0761-42da-a5d0-cb73327a07c0 tempest-VolumesGetTestJSON-1251262402 tempest-VolumesGetTestJSON-1251262402-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/8669788b-4a6c-4970-a59a-ac2c1108bbfe" status: 202 len: 0 microversion: 2.1 time: 0.065649 Apr 14 19:06:39 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 325/973] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 19:06:39 2023] DELETE /compute/v2.1/os-volumes/8669788b-4a6c-4970-a59a-ac2c1108bbfe => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 19:06:39 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-0e4e9f58-f241-4d55-aaf1-c3d7fedeb9cb tempest-VolumesGetTestJSON-1251262402 tempest-VolumesGetTestJSON-1251262402-project-member] Calling method '.version_select at 0x7fdae10a0790>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:06:39 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-0e4e9f58-f241-4d55-aaf1-c3d7fedeb9cb tempest-VolumesGetTestJSON-1251262402 tempest-VolumesGetTestJSON-1251262402-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8669788b-4a6c-4970-a59a-ac2c1108bbfe" status: 200 len: 352 microversion: 2.1 time: 0.055381 Apr 14 19:06:39 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 322/974] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 19:06:39 2023] GET /compute/v2.1/os-volumes/8669788b-4a6c-4970-a59a-ac2c1108bbfe => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:06:40 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-cafc41b7-406b-4e0d-ac61-66e07c0ab53f tempest-VolumesGetTestJSON-1251262402 tempest-VolumesGetTestJSON-1251262402-project-member] Calling method '.version_select at 0x7fdae0f3e9e0>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:06:40 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-cafc41b7-406b-4e0d-ac61-66e07c0ab53f tempest-VolumesGetTestJSON-1251262402 tempest-VolumesGetTestJSON-1251262402-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8669788b-4a6c-4970-a59a-ac2c1108bbfe" status: 200 len: 352 microversion: 2.1 time: 0.058634 Apr 14 19:06:40 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 328/975] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 19:06:40 2023] GET /compute/v2.1/os-volumes/8669788b-4a6c-4970-a59a-ac2c1108bbfe => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:06:41 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-b166cbc5-9493-489f-919a-5016456fd1dc tempest-VolumesGetTestJSON-1251262402 tempest-VolumesGetTestJSON-1251262402-project-member] Calling method '.version_select at 0x7fdae11544c0>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:06:41 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-b166cbc5-9493-489f-919a-5016456fd1dc tempest-VolumesGetTestJSON-1251262402 tempest-VolumesGetTestJSON-1251262402-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8669788b-4a6c-4970-a59a-ac2c1108bbfe" status: 200 len: 352 microversion: 2.1 time: 0.051507 Apr 14 19:06:41 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 326/976] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 19:06:41 2023] GET /compute/v2.1/os-volumes/8669788b-4a6c-4970-a59a-ac2c1108bbfe => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:06:42 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-12ed2891-e1cb-40d4-a751-b2c68a4b1b92 tempest-VolumesGetTestJSON-1251262402 tempest-VolumesGetTestJSON-1251262402-project-member] Calling method '.version_select at 0x7fdae1594ee0>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:06:42 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-12ed2891-e1cb-40d4-a751-b2c68a4b1b92 tempest-VolumesGetTestJSON-1251262402 tempest-VolumesGetTestJSON-1251262402-project-member] HTTP exception thrown: Volume 8669788b-4a6c-4970-a59a-ac2c1108bbfe could not be found. Apr 14 19:06:42 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-12ed2891-e1cb-40d4-a751-b2c68a4b1b92 tempest-VolumesGetTestJSON-1251262402 tempest-VolumesGetTestJSON-1251262402-project-member] Request method failure captured: Apr 14 19:06:42 user devstack@n-api.service[61673]: request: GET /compute/v2.1/os-volumes/8669788b-4a6c-4970-a59a-ac2c1108bbfe HTTP/1.1 Apr 14 19:06:42 user devstack@n-api.service[61673]: Accept: application/json Apr 14 19:06:42 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 19:06:42 user devstack@n-api.service[61673]: Connection: close Apr 14 19:06:42 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 19:06:42 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 19:06:42 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 19:06:42 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 19:06:42 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 19:06:42 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOaQ79-V1zdbKeVZusnjqNhw_yaPI8VQ9YUmi4iZ6Mz4HOo3fLoPnDrmjf0d_Qs6jLpYPwdRIWa_X_LteVSMxNdfDSRBC-6TMeqncKSsT-4T7h7YIRq_5-otAC-ZARPH-OcN1imIwTUBYdQ8LBFlgnT4KouJxVivyvRhkp4g_l-R8ssQ Apr 14 19:06:42 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 19:06:42 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 19:06:42 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 19:06:42 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 19:06:42 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 19:06:42 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 19:06:42 user devstack@n-api.service[61673]: X-Project-Id: 9d7d27d9ff8c4a2fb57f84d91b43666f Apr 14 19:06:42 user devstack@n-api.service[61673]: X-Project-Name: tempest-VolumesGetTestJSON-1251262402 Apr 14 19:06:42 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 19:06:42 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 19:06:42 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9d7d27d9ff8c4a2fb57f84d91b43666f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9d7d27d9ff8c4a2fb57f84d91b43666f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9d7d27d9ff8c4a2fb57f84d91b43666f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:06:42 user devstack@n-api.service[61673]: X-Tenant: tempest-VolumesGetTestJSON-1251262402 Apr 14 19:06:42 user devstack@n-api.service[61673]: X-Tenant-Id: 9d7d27d9ff8c4a2fb57f84d91b43666f Apr 14 19:06:42 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-VolumesGetTestJSON-1251262402 Apr 14 19:06:42 user devstack@n-api.service[61673]: X-User: tempest-VolumesGetTestJSON-1251262402-project-member Apr 14 19:06:42 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 19:06:42 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 19:06:42 user devstack@n-api.service[61673]: X-User-Id: b891c5abfc5a4a7b99c399097f98096c Apr 14 19:06:42 user devstack@n-api.service[61673]: X-User-Name: tempest-VolumesGetTestJSON-1251262402-project-member Apr 14 19:06:42 user devstack@n-api.service[61673]: method: Apr 14 19:06:42 user devstack@n-api.service[61673]: exception: Volume 8669788b-4a6c-4970-a59a-ac2c1108bbfe could not be found. Apr 14 19:06:42 user devstack@n-api.service[61673]: action_args: {'id': '8669788b-4a6c-4970-a59a-ac2c1108bbfe'} Apr 14 19:06:42 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8669788b-4a6c-4970-a59a-ac2c1108bbfe could not be found. (HTTP 404) (Request-ID: req-48616bc3-ca60-454d-94a9-b93a273894b4) Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8669788b-4a6c-4970-a59a-ac2c1108bbfe could not be found. Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8669788b-4a6c-4970-a59a-ac2c1108bbfe could not be found. Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8669788b-4a6c-4970-a59a-ac2c1108bbfe could not be found. Apr 14 19:06:42 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:06:42 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-12ed2891-e1cb-40d4-a751-b2c68a4b1b92 tempest-VolumesGetTestJSON-1251262402 tempest-VolumesGetTestJSON-1251262402-project-member] Returning 404 to user: Volume 8669788b-4a6c-4970-a59a-ac2c1108bbfe could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:06:42 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-12ed2891-e1cb-40d4-a751-b2c68a4b1b92 tempest-VolumesGetTestJSON-1251262402 tempest-VolumesGetTestJSON-1251262402-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8669788b-4a6c-4970-a59a-ac2c1108bbfe" status: 404 len: 109 microversion: 2.1 time: 0.040940 Apr 14 19:06:42 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 323/977] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 19:06:42 2023] GET /compute/v2.1/os-volumes/8669788b-4a6c-4970-a59a-ac2c1108bbfe => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:06:51 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:06:51 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:06:51 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-84ac6988-8511-4b05-9019-b8a0b3f873fc tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:06:51 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-84ac6988-8511-4b05-9019-b8a0b3f873fc tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:06:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-84ac6988-8511-4b05-9019-b8a0b3f873fc tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-84ac6988-8511-4b05-9019-b8a0b3f873fc tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-84ac6988-8511-4b05-9019-b8a0b3f873fc tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-84ac6988-8511-4b05-9019-b8a0b3f873fc tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-84ac6988-8511-4b05-9019-b8a0b3f873fc tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:51 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-84ac6988-8511-4b05-9019-b8a0b3f873fc tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:51 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-84ac6988-8511-4b05-9019-b8a0b3f873fc tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055742 Apr 14 19:06:51 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 329/978] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 19:06:51 2023] GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 19:06:58 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=10 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:06:58 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=22 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:06:58 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8bd69239-e6ac-4562-82d2-0e37f8202f4d"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:06:58 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:06:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:06:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:06:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:06:58 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.664030 Apr 14 19:06:58 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 327/979] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 19:06:58 2023] POST /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments => generated 194 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:07:08 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:07:08 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=8 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:07:08 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:07:08 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:07:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:08 user devstack@n-api.service[61673]: DEBUG nova.objects.instance [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lazy-loading 'services' on Instance uuid a9379580-fd2f-4468-9ed3-7109735195be {{(pid=61673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 19:07:08 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments/8bd69239-e6ac-4562-82d2-0e37f8202f4d" status: 202 len: 0 microversion: 2.1 time: 0.333890 Apr 14 19:07:08 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 324/980] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 19:07:08 2023] DELETE /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments/8bd69239-e6ac-4562-82d2-0e37f8202f4d => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 19:07:08 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-8019a049-2a07-4486-b08e-8ad9cb941c8b tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:07:08 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-8019a049-2a07-4486-b08e-8ad9cb941c8b tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:07:08 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:07:08 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=6 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:07:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8019a049-2a07-4486-b08e-8ad9cb941c8b tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8019a049-2a07-4486-b08e-8ad9cb941c8b tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8019a049-2a07-4486-b08e-8ad9cb941c8b tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8019a049-2a07-4486-b08e-8ad9cb941c8b tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8019a049-2a07-4486-b08e-8ad9cb941c8b tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-8019a049-2a07-4486-b08e-8ad9cb941c8b tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:08 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-8019a049-2a07-4486-b08e-8ad9cb941c8b tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056747 Apr 14 19:07:08 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 330/981] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 19:07:08 2023] GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:07:09 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:07:09 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:07:09 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-84999ac9-3870-49f7-84be-230a9069dc4e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:07:09 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-84999ac9-3870-49f7-84be-230a9069dc4e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:07:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-84999ac9-3870-49f7-84be-230a9069dc4e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-84999ac9-3870-49f7-84be-230a9069dc4e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-84999ac9-3870-49f7-84be-230a9069dc4e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-84999ac9-3870-49f7-84be-230a9069dc4e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-84999ac9-3870-49f7-84be-230a9069dc4e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-84999ac9-3870-49f7-84be-230a9069dc4e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:09 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-84999ac9-3870-49f7-84be-230a9069dc4e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] HTTP exception thrown: Instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 could not be found. Apr 14 19:07:09 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-84999ac9-3870-49f7-84be-230a9069dc4e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Request method failure captured: Apr 14 19:07:09 user devstack@n-api.service[61675]: request: GET /compute/v2.1/servers/f3fde6b1-ddc9-400e-a032-f80cd32bad39 HTTP/1.1 Apr 14 19:07:09 user devstack@n-api.service[61675]: Accept: application/json Apr 14 19:07:09 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 19:07:09 user devstack@n-api.service[61675]: Connection: close Apr 14 19:07:09 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 19:07:09 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 19:07:09 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 19:07:09 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 19:07:09 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 19:07:09 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOaGjzEHP4gR4MoApqz0vJpRX2_SvaMHlWJEk_fU7mYw99OWl-qUsSQ6rEQ6kqDrRwocqp34lWfQib95-KwgiyuwPlyVpsmwfmwLReClbkEHff7utOAgEbSdfwWoPS9VLZQQ0SJcp_M6aCZY6cryOh5BrJ2VueTzigMFoaeOsa0D5fWA Apr 14 19:07:09 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 19:07:09 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 19:07:09 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 19:07:09 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 19:07:09 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 19:07:09 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 19:07:09 user devstack@n-api.service[61675]: X-Project-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 19:07:09 user devstack@n-api.service[61675]: X-Project-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:07:09 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 19:07:09 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 19:07:09 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:07:09 user devstack@n-api.service[61675]: X-Tenant: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:07:09 user devstack@n-api.service[61675]: X-Tenant-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 19:07:09 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:07:09 user devstack@n-api.service[61675]: X-User: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 19:07:09 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 19:07:09 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 19:07:09 user devstack@n-api.service[61675]: X-User-Id: fc3bed70703a49c8bdec2f50193c7f70 Apr 14 19:07:09 user devstack@n-api.service[61675]: X-User-Name: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 19:07:09 user devstack@n-api.service[61675]: method: > Apr 14 19:07:09 user devstack@n-api.service[61675]: exception: Instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 could not be found. Apr 14 19:07:09 user devstack@n-api.service[61675]: action_args: {'id': 'f3fde6b1-ddc9-400e-a032-f80cd32bad39'} Apr 14 19:07:09 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 could not be found. Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 could not be found. Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 could not be found. Apr 14 19:07:09 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:07:09 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-84999ac9-3870-49f7-84be-230a9069dc4e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Returning 404 to user: Instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:07:09 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-84999ac9-3870-49f7-84be-230a9069dc4e tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3fde6b1-ddc9-400e-a032-f80cd32bad39" status: 404 len: 111 microversion: 2.1 time: 0.041084 Apr 14 19:07:09 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 328/982] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:07:09 2023] GET /compute/v2.1/servers/f3fde6b1-ddc9-400e-a032-f80cd32bad39 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:07:09 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1288950807", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-875294368", "security_groups": [{"name": "tempest-secgroup-smoke-304973525"}], "block_device_mapping_v2": [{"uuid": "126e30a2-deeb-433e-a8b5-e9970ffc15af", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70"}]}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:07:09 user devstack@n-api.service[61673]: DEBUG nova.network.neutron [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] validate_networks() for [('bfa4fdbb-10b3-4715-9ff2-b717d052cc70', None, None, None, None, None)] {{(pid=61673) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 19:07:10 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flavor limits 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 19:07:10 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Image limits 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 19:07:10 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flavor pref 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 19:07:10 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Image pref 0:0:0 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 19:07:10 user devstack@n-api.service[61673]: DEBUG nova.virt.hardware [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 19:07:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:10 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:10 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Getting quotas for project 72d2bf68325a4a18934a8403571c24bb. Resources: {'ram', 'instances', 'cores'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 19:07:10 user devstack@n-api.service[61673]: DEBUG nova.quota [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Getting quotas for user fc3bed70703a49c8bdec2f50193c7f70 and project 72d2bf68325a4a18934a8403571c24bb. Resources: {'ram', 'instances', 'cores'} {{(pid=61673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 19:07:10 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Going to run 1 instances... {{(pid=61673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 19:07:10 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='126e30a2-deeb-433e-a8b5-e9970ffc15af',volume_size=None,volume_type=None)] {{(pid=61673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 19:07:10 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.835575 Apr 14 19:07:10 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 325/983] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 19:07:09 2023] POST /compute/v2.1/servers => generated 403 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 19:07:10 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-33d826b6-c3c8-4cb1-bedf-aecabc9b5544 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:07:10 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-33d826b6-c3c8-4cb1-bedf-aecabc9b5544 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:07:10 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-33d826b6-c3c8-4cb1-bedf-aecabc9b5544 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:07:10 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-33d826b6-c3c8-4cb1-bedf-aecabc9b5544 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/935022b4-4ba7-4b34-a758-a00081240b4c" status: 200 len: 1089 microversion: 2.1 time: 0.086063 Apr 14 19:07:10 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 331/984] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:07:10 2023] GET /compute/v2.1/servers/935022b4-4ba7-4b34-a758-a00081240b4c => generated 1089 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:07:13 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-077f07f9-10e7-4ff9-b864-8f561051b4af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "732c36bf-d3d1-437c-91f5-710fea1de62b"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:07:13 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-077f07f9-10e7-4ff9-b864-8f561051b4af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:07:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-077f07f9-10e7-4ff9-b864-8f561051b4af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-077f07f9-10e7-4ff9-b864-8f561051b4af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-077f07f9-10e7-4ff9-b864-8f561051b4af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-077f07f9-10e7-4ff9-b864-8f561051b4af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-077f07f9-10e7-4ff9-b864-8f561051b4af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-077f07f9-10e7-4ff9-b864-8f561051b4af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:13 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-aaeed17b-f511-42f7-acf1-6a556cb25c5a req-723d3108-7b1a-4d99-baf9-bed3ae803276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "935022b4-4ba7-4b34-a758-a00081240b4c", "tag": "ef166576-430e-47da-b169-915c4a0cd97c"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:07:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-aaeed17b-f511-42f7-acf1-6a556cb25c5a req-723d3108-7b1a-4d99-baf9-bed3ae803276 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-aaeed17b-f511-42f7-acf1-6a556cb25c5a req-723d3108-7b1a-4d99-baf9-bed3ae803276 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-aaeed17b-f511-42f7-acf1-6a556cb25c5a req-723d3108-7b1a-4d99-baf9-bed3ae803276 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:13 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-aaeed17b-f511-42f7-acf1-6a556cb25c5a req-723d3108-7b1a-4d99-baf9-bed3ae803276 service nova] Creating event network-changed:ef166576-430e-47da-b169-915c4a0cd97c for instance 935022b4-4ba7-4b34-a758-a00081240b4c on user Apr 14 19:07:13 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-aaeed17b-f511-42f7-acf1-6a556cb25c5a req-723d3108-7b1a-4d99-baf9-bed3ae803276 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.245019 Apr 14 19:07:13 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 326/985] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:07:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:07:13 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-077f07f9-10e7-4ff9-b864-8f561051b4af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "POST /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.351245 Apr 14 19:07:13 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 329/986] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 19:07:13 2023] POST /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a/os-volume_attachments => generated 188 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 19:07:14 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:07:14 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:07:14 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:14 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:14 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:14 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:14 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:14 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:14 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61674) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 19:07:14 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "POST /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a/action" status: 202 len: 0 microversion: 2.20 time: 0.331927 Apr 14 19:07:14 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 332/987] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 19:07:14 2023] POST /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 19:07:14 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-39e1399d-069f-42e5-a313-4106d745a851 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:07:14 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-39e1399d-069f-42e5-a313-4106d745a851 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:07:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-39e1399d-069f-42e5-a313-4106d745a851 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-39e1399d-069f-42e5-a313-4106d745a851 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-39e1399d-069f-42e5-a313-4106d745a851 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-39e1399d-069f-42e5-a313-4106d745a851 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-39e1399d-069f-42e5-a313-4106d745a851 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-39e1399d-069f-42e5-a313-4106d745a851 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:14 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-39e1399d-069f-42e5-a313-4106d745a851 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:07:14 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-39e1399d-069f-42e5-a313-4106d745a851 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:07:14 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-39e1399d-069f-42e5-a313-4106d745a851 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:07:14 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-39e1399d-069f-42e5-a313-4106d745a851 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a" status: 200 len: 1739 microversion: 2.20 time: 0.264192 Apr 14 19:07:14 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 327/988] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:07:14 2023] GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a => generated 1739 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 19:07:20 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-ae953f0e-0ed7-4232-861c-095909ac072c req-08cb7ffb-0897-423a-a4db-671590db662d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "935022b4-4ba7-4b34-a758-a00081240b4c", "name": "network-vif-plugged", "status": "completed", "tag": "ef166576-430e-47da-b169-915c4a0cd97c"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:07:20 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-ae953f0e-0ed7-4232-861c-095909ac072c req-08cb7ffb-0897-423a-a4db-671590db662d service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:20 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-ae953f0e-0ed7-4232-861c-095909ac072c req-08cb7ffb-0897-423a-a4db-671590db662d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:20 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-ae953f0e-0ed7-4232-861c-095909ac072c req-08cb7ffb-0897-423a-a4db-671590db662d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:20 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-ae953f0e-0ed7-4232-861c-095909ac072c req-08cb7ffb-0897-423a-a4db-671590db662d service nova] Creating event network-vif-plugged:ef166576-430e-47da-b169-915c4a0cd97c for instance 935022b4-4ba7-4b34-a758-a00081240b4c on user Apr 14 19:07:20 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-ae953f0e-0ed7-4232-861c-095909ac072c req-08cb7ffb-0897-423a-a4db-671590db662d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028795 Apr 14 19:07:20 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 330/989] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:07:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:07:22 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-7f613b68-6d09-4a6d-a4bd-0f4ebe1c5777 req-38e34ba5-5be8-47e6-9185-c094bd6f10c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "935022b4-4ba7-4b34-a758-a00081240b4c", "name": "network-vif-plugged", "status": "completed", "tag": "ef166576-430e-47da-b169-915c4a0cd97c"}, {"name": "network-changed", "server_uuid": "179270ef-7866-4ee7-af13-ec3ea5e7525a", "tag": "fef01e15-9070-4b0b-ba18-0b9540774cb9"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:07:22 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:07:22 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-7f613b68-6d09-4a6d-a4bd-0f4ebe1c5777 req-38e34ba5-5be8-47e6-9185-c094bd6f10c4 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:22 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-7f613b68-6d09-4a6d-a4bd-0f4ebe1c5777 req-38e34ba5-5be8-47e6-9185-c094bd6f10c4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:22 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-7f613b68-6d09-4a6d-a4bd-0f4ebe1c5777 req-38e34ba5-5be8-47e6-9185-c094bd6f10c4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:22 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-7f613b68-6d09-4a6d-a4bd-0f4ebe1c5777 req-38e34ba5-5be8-47e6-9185-c094bd6f10c4 service nova] Creating event network-vif-plugged:ef166576-430e-47da-b169-915c4a0cd97c for instance 935022b4-4ba7-4b34-a758-a00081240b4c on user Apr 14 19:07:22 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-7f613b68-6d09-4a6d-a4bd-0f4ebe1c5777 req-38e34ba5-5be8-47e6-9185-c094bd6f10c4 service nova] Creating event network-changed:fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance 179270ef-7866-4ee7-af13-ec3ea5e7525a on user Apr 14 19:07:22 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-7f613b68-6d09-4a6d-a4bd-0f4ebe1c5777 req-38e34ba5-5be8-47e6-9185-c094bd6f10c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.064028 Apr 14 19:07:22 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 333/990] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:07:22 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:07:23 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:07:23 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=6 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:07:23 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-f000dc80-e6f5-468e-8f69-611ad5661ca3 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:07:23 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-f000dc80-e6f5-468e-8f69-611ad5661ca3 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:07:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f000dc80-e6f5-468e-8f69-611ad5661ca3 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f000dc80-e6f5-468e-8f69-611ad5661ca3 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f000dc80-e6f5-468e-8f69-611ad5661ca3 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f000dc80-e6f5-468e-8f69-611ad5661ca3 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f000dc80-e6f5-468e-8f69-611ad5661ca3 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f000dc80-e6f5-468e-8f69-611ad5661ca3 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:24 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-f000dc80-e6f5-468e-8f69-611ad5661ca3 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:07:24 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-f000dc80-e6f5-468e-8f69-611ad5661ca3 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468" status: 200 len: 1546 microversion: 2.1 time: 0.533432 Apr 14 19:07:24 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 328/991] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:07:23 2023] GET /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468 => generated 1546 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:07:24 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-54afe4c7-7b80-42cb-beef-dde85c0c2414 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:07:24 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-54afe4c7-7b80-42cb-beef-dde85c0c2414 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:07:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-54afe4c7-7b80-42cb-beef-dde85c0c2414 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-54afe4c7-7b80-42cb-beef-dde85c0c2414 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-54afe4c7-7b80-42cb-beef-dde85c0c2414 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-54afe4c7-7b80-42cb-beef-dde85c0c2414 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-54afe4c7-7b80-42cb-beef-dde85c0c2414 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-54afe4c7-7b80-42cb-beef-dde85c0c2414 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:24 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-54afe4c7-7b80-42cb-beef-dde85c0c2414 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468/action" status: 200 len: 28414 microversion: 2.1 time: 0.349236 Apr 14 19:07:24 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 331/992] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 19:07:24 2023] POST /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468/action => generated 28414 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 19:07:24 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-fef75d57-1f73-4fb4-9182-fd19fcbbfe73 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:07:24 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-fef75d57-1f73-4fb4-9182-fd19fcbbfe73 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:07:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fef75d57-1f73-4fb4-9182-fd19fcbbfe73 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fef75d57-1f73-4fb4-9182-fd19fcbbfe73 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fef75d57-1f73-4fb4-9182-fd19fcbbfe73 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fef75d57-1f73-4fb4-9182-fd19fcbbfe73 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fef75d57-1f73-4fb4-9182-fd19fcbbfe73 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:24 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fef75d57-1f73-4fb4-9182-fd19fcbbfe73 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:24 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-fef75d57-1f73-4fb4-9182-fd19fcbbfe73 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:07:24 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-fef75d57-1f73-4fb4-9182-fd19fcbbfe73 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46d51513-1995-43c5-976a-40789ae575f1" status: 200 len: 1539 microversion: 2.1 time: 0.267804 Apr 14 19:07:24 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 334/993] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:07:24 2023] GET /compute/v2.1/servers/46d51513-1995-43c5-976a-40789ae575f1 => generated 1539 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:07:25 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-a6a03a40-d3c2-40bf-8567-e8614f1e36bf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:07:25 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-a6a03a40-d3c2-40bf-8567-e8614f1e36bf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:07:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a6a03a40-d3c2-40bf-8567-e8614f1e36bf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a6a03a40-d3c2-40bf-8567-e8614f1e36bf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a6a03a40-d3c2-40bf-8567-e8614f1e36bf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a6a03a40-d3c2-40bf-8567-e8614f1e36bf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a6a03a40-d3c2-40bf-8567-e8614f1e36bf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-a6a03a40-d3c2-40bf-8567-e8614f1e36bf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:25 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-a6a03a40-d3c2-40bf-8567-e8614f1e36bf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] HTTP exception thrown: Instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 could not be found. Apr 14 19:07:25 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-a6a03a40-d3c2-40bf-8567-e8614f1e36bf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Request method failure captured: Apr 14 19:07:25 user devstack@n-api.service[61673]: request: GET /compute/v2.1/servers/cf640f3e-3d77-46ee-8a11-e0bdc870ff97 HTTP/1.1 Apr 14 19:07:25 user devstack@n-api.service[61673]: Accept: application/json Apr 14 19:07:25 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 19:07:25 user devstack@n-api.service[61673]: Connection: close Apr 14 19:07:25 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 19:07:25 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 19:07:25 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 19:07:25 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 19:07:25 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 19:07:25 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOaBsVI_nvkyYSUnUpk_9LZivhBf1YZK5uRUFFR2iv7YLDTugI5hWoRijQ-9F1cI4hDuKdzxQWbf2lUpXfxiTO1q10jdi5iIMybz9kkHtzg_mWEjrwYVtbLI2p_4_sZODWdXkFWOQ0NLBMotwKrDrF_4nfgQcIHiwUOtMf5a-BxmB6jA Apr 14 19:07:25 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 19:07:25 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 19:07:25 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 19:07:25 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 19:07:25 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 19:07:25 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 19:07:25 user devstack@n-api.service[61673]: X-Project-Id: e60e8abd123e414f847c68ba72894689 Apr 14 19:07:25 user devstack@n-api.service[61673]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1174646715 Apr 14 19:07:25 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 19:07:25 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 19:07:25 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e60e8abd123e414f847c68ba72894689"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e60e8abd123e414f847c68ba72894689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e60e8abd123e414f847c68ba72894689"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:07:25 user devstack@n-api.service[61673]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1174646715 Apr 14 19:07:25 user devstack@n-api.service[61673]: X-Tenant-Id: e60e8abd123e414f847c68ba72894689 Apr 14 19:07:25 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1174646715 Apr 14 19:07:25 user devstack@n-api.service[61673]: X-User: tempest-ServerRescueNegativeTestJSON-1174646715-project-member Apr 14 19:07:25 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 19:07:25 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 19:07:25 user devstack@n-api.service[61673]: X-User-Id: c8713ed85ffb4446847f5ded4bc2e399 Apr 14 19:07:25 user devstack@n-api.service[61673]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1174646715-project-member Apr 14 19:07:25 user devstack@n-api.service[61673]: method: > Apr 14 19:07:25 user devstack@n-api.service[61673]: exception: Instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 could not be found. Apr 14 19:07:25 user devstack@n-api.service[61673]: action_args: {'id': 'cf640f3e-3d77-46ee-8a11-e0bdc870ff97'} Apr 14 19:07:25 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 could not be found. Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 could not be found. Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 could not be found. Apr 14 19:07:25 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:07:25 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-a6a03a40-d3c2-40bf-8567-e8614f1e36bf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Returning 404 to user: Instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:07:25 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-a6a03a40-d3c2-40bf-8567-e8614f1e36bf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf640f3e-3d77-46ee-8a11-e0bdc870ff97" status: 404 len: 111 microversion: 2.1 time: 0.036989 Apr 14 19:07:25 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 329/994] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:07:25 2023] GET /compute/v2.1/servers/cf640f3e-3d77-46ee-8a11-e0bdc870ff97 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:07:25 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:07:25 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:07:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:25 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:25 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Going to try to terminate instance {{(pid=61675) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 19:07:25 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1d305ab4-1813-4728-a01c-287e521a05ec" status: 204 len: 0 microversion: 2.1 time: 0.142553 Apr 14 19:07:25 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 332/995] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:07:25 2023] DELETE /compute/v2.1/servers/1d305ab4-1813-4728-a01c-287e521a05ec => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 14 19:07:25 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-84cc486f-2e28-4251-a000-5a4876dda225 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:07:25 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-84cc486f-2e28-4251-a000-5a4876dda225 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:07:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-84cc486f-2e28-4251-a000-5a4876dda225 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-84cc486f-2e28-4251-a000-5a4876dda225 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-84cc486f-2e28-4251-a000-5a4876dda225 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-84cc486f-2e28-4251-a000-5a4876dda225 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-84cc486f-2e28-4251-a000-5a4876dda225 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-84cc486f-2e28-4251-a000-5a4876dda225 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:25 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-84cc486f-2e28-4251-a000-5a4876dda225 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8713ed85ffb4446847f5ded4bc2e399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60e8abd123e414f847c68ba72894689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:07:25 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-84cc486f-2e28-4251-a000-5a4876dda225 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d305ab4-1813-4728-a01c-287e521a05ec" status: 200 len: 1510 microversion: 2.1 time: 0.415065 Apr 14 19:07:25 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 335/996] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:07:25 2023] GET /compute/v2.1/servers/1d305ab4-1813-4728-a01c-287e521a05ec => generated 1510 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:07:26 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-4828be5d-4e63-4d9f-9e54-4ee97a940694 req-70abb5a7-44e1-43db-856d-18652ff35af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d305ab4-1813-4728-a01c-287e521a05ec", "name": "network-vif-unplugged", "status": "completed", "tag": "d07ff847-3983-4b35-af36-fbd845ede770"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:07:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-4828be5d-4e63-4d9f-9e54-4ee97a940694 req-70abb5a7-44e1-43db-856d-18652ff35af0 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-4828be5d-4e63-4d9f-9e54-4ee97a940694 req-70abb5a7-44e1-43db-856d-18652ff35af0 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:26 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-4828be5d-4e63-4d9f-9e54-4ee97a940694 req-70abb5a7-44e1-43db-856d-18652ff35af0 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:26 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-4828be5d-4e63-4d9f-9e54-4ee97a940694 req-70abb5a7-44e1-43db-856d-18652ff35af0 service nova] Creating event network-vif-unplugged:d07ff847-3983-4b35-af36-fbd845ede770 for instance 1d305ab4-1813-4728-a01c-287e521a05ec on user Apr 14 19:07:26 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-4828be5d-4e63-4d9f-9e54-4ee97a940694 req-70abb5a7-44e1-43db-856d-18652ff35af0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.274658 Apr 14 19:07:26 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 330/997] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:07:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:07:27 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-09de6ccc-78b1-484d-a8da-53fa75f3205a req-1568034a-6e6c-4b01-85b8-ed29800a1ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d305ab4-1813-4728-a01c-287e521a05ec", "name": "network-vif-deleted", "tag": "d07ff847-3983-4b35-af36-fbd845ede770"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:07:27 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-09de6ccc-78b1-484d-a8da-53fa75f3205a req-1568034a-6e6c-4b01-85b8-ed29800a1ba2 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:27 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-09de6ccc-78b1-484d-a8da-53fa75f3205a req-1568034a-6e6c-4b01-85b8-ed29800a1ba2 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:27 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-09de6ccc-78b1-484d-a8da-53fa75f3205a req-1568034a-6e6c-4b01-85b8-ed29800a1ba2 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:27 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-09de6ccc-78b1-484d-a8da-53fa75f3205a req-1568034a-6e6c-4b01-85b8-ed29800a1ba2 service nova] Creating event network-vif-deleted:d07ff847-3983-4b35-af36-fbd845ede770 for instance 1d305ab4-1813-4728-a01c-287e521a05ec on user Apr 14 19:07:27 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-09de6ccc-78b1-484d-a8da-53fa75f3205a req-1568034a-6e6c-4b01-85b8-ed29800a1ba2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030049 Apr 14 19:07:27 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 333/998] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:07:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:07:28 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-364fd9f1-4597-432b-bb38-6a590c747a75 req-ceac89e6-7de5-44d0-955b-b8f4bb3d94d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d305ab4-1813-4728-a01c-287e521a05ec", "name": "network-vif-plugged", "status": "completed", "tag": "d07ff847-3983-4b35-af36-fbd845ede770"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:07:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-364fd9f1-4597-432b-bb38-6a590c747a75 req-ceac89e6-7de5-44d0-955b-b8f4bb3d94d6 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-364fd9f1-4597-432b-bb38-6a590c747a75 req-ceac89e6-7de5-44d0-955b-b8f4bb3d94d6 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-364fd9f1-4597-432b-bb38-6a590c747a75 req-ceac89e6-7de5-44d0-955b-b8f4bb3d94d6 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:28 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-364fd9f1-4597-432b-bb38-6a590c747a75 req-ceac89e6-7de5-44d0-955b-b8f4bb3d94d6 service nova] Creating event network-vif-plugged:d07ff847-3983-4b35-af36-fbd845ede770 for instance 1d305ab4-1813-4728-a01c-287e521a05ec on user Apr 14 19:07:28 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-364fd9f1-4597-432b-bb38-6a590c747a75 req-ceac89e6-7de5-44d0-955b-b8f4bb3d94d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037353 Apr 14 19:07:28 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 336/999] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:07:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:07:30 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-5ec95c2c-4789-4c1a-bda3-5cb3afa52983 req-a48295f2-feb5-40e4-b455-34e104109f9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179270ef-7866-4ee7-af13-ec3ea5e7525a", "name": "network-vif-plugged", "status": "completed", "tag": "fef01e15-9070-4b0b-ba18-0b9540774cb9"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:07:30 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-5ec95c2c-4789-4c1a-bda3-5cb3afa52983 req-a48295f2-feb5-40e4-b455-34e104109f9c service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:30 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-5ec95c2c-4789-4c1a-bda3-5cb3afa52983 req-a48295f2-feb5-40e4-b455-34e104109f9c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:30 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-5ec95c2c-4789-4c1a-bda3-5cb3afa52983 req-a48295f2-feb5-40e4-b455-34e104109f9c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:30 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-5ec95c2c-4789-4c1a-bda3-5cb3afa52983 req-a48295f2-feb5-40e4-b455-34e104109f9c service nova] Creating event network-vif-plugged:fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance 179270ef-7866-4ee7-af13-ec3ea5e7525a on user Apr 14 19:07:30 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-5ec95c2c-4789-4c1a-bda3-5cb3afa52983 req-a48295f2-feb5-40e4-b455-34e104109f9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058635 Apr 14 19:07:30 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 331/1000] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:07:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:07:32 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-93a7ac43-a881-4622-90a0-d17068810b28 req-642a0ab8-ba14-427a-90e9-6f16b0c3ac57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179270ef-7866-4ee7-af13-ec3ea5e7525a", "name": "network-vif-plugged", "status": "completed", "tag": "fef01e15-9070-4b0b-ba18-0b9540774cb9"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:07:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-93a7ac43-a881-4622-90a0-d17068810b28 req-642a0ab8-ba14-427a-90e9-6f16b0c3ac57 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-93a7ac43-a881-4622-90a0-d17068810b28 req-642a0ab8-ba14-427a-90e9-6f16b0c3ac57 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-93a7ac43-a881-4622-90a0-d17068810b28 req-642a0ab8-ba14-427a-90e9-6f16b0c3ac57 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:32 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-93a7ac43-a881-4622-90a0-d17068810b28 req-642a0ab8-ba14-427a-90e9-6f16b0c3ac57 service nova] Creating event network-vif-plugged:fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance 179270ef-7866-4ee7-af13-ec3ea5e7525a on user Apr 14 19:07:32 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-93a7ac43-a881-4622-90a0-d17068810b28 req-642a0ab8-ba14-427a-90e9-6f16b0c3ac57 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056231 Apr 14 19:07:32 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 334/1001] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:07:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:07:40 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:07:40 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:07:40 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-483537759", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "networks": [{"uuid": "d351be52-944c-4631-9649-ce34a967f20a"}]}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:07:40 user devstack@n-api.service[61674]: DEBUG nova.network.neutron [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] validate_networks() for [('d351be52-944c-4631-9649-ce34a967f20a', None, None, None, None, None)] {{(pid=61674) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 19:07:41 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Flavor limits 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 19:07:41 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Image limits 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 19:07:41 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Flavor pref 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 19:07:41 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Image pref 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 19:07:41 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 19:07:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:41 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Getting quotas for project 5f71b0490e5a4d3b9300dc510b936a44. Resources: {'ram', 'instances', 'cores'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 19:07:41 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Getting quotas for user 0b1b6efb65b541ef992b66d9d06bd03f and project 5f71b0490e5a4d3b9300dc510b936a44. Resources: {'ram', 'instances', 'cores'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 19:07:41 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Going to run 1 instances... {{(pid=61674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 19:07:41 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 19:07:41 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.882452 Apr 14 19:07:41 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 337/1002] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 19:07:40 2023] POST /compute/v2.1/servers => generated 378 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 19:07:41 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-d861732b-ea9b-49c5-8192-3a4aa33eb2dd tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:07:41 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-d861732b-ea9b-49c5-8192-3a4aa33eb2dd tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:07:41 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:07:41 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:07:41 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-d861732b-ea9b-49c5-8192-3a4aa33eb2dd tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1b6efb65b541ef992b66d9d06bd03f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f71b0490e5a4d3b9300dc510b936a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:07:41 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-d861732b-ea9b-49c5-8192-3a4aa33eb2dd tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dab65dfd-f2a1-4631-82a2-70a18f0f33f7" status: 200 len: 1207 microversion: 2.1 time: 0.076608 Apr 14 19:07:41 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 332/1003] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:07:41 2023] GET /compute/v2.1/servers/dab65dfd-f2a1-4631-82a2-70a18f0f33f7 => generated 1207 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:07:43 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:07:43 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=42,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:07:43 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-012adb01-e625-42d1-b5ff-b37d1227653e req-83bf3589-1e7a-49ea-bfab-0f161b1d6827 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dab65dfd-f2a1-4631-82a2-70a18f0f33f7", "tag": "7c974323-9ad0-4786-b46b-27b6d54a612b"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:07:43 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-012adb01-e625-42d1-b5ff-b37d1227653e req-83bf3589-1e7a-49ea-bfab-0f161b1d6827 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:43 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-012adb01-e625-42d1-b5ff-b37d1227653e req-83bf3589-1e7a-49ea-bfab-0f161b1d6827 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:43 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-012adb01-e625-42d1-b5ff-b37d1227653e req-83bf3589-1e7a-49ea-bfab-0f161b1d6827 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:43 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-012adb01-e625-42d1-b5ff-b37d1227653e req-83bf3589-1e7a-49ea-bfab-0f161b1d6827 service nova] Creating event network-changed:7c974323-9ad0-4786-b46b-27b6d54a612b for instance dab65dfd-f2a1-4631-82a2-70a18f0f33f7 on user Apr 14 19:07:43 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-012adb01-e625-42d1-b5ff-b37d1227653e req-83bf3589-1e7a-49ea-bfab-0f161b1d6827 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049399 Apr 14 19:07:43 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 335/1004] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:07:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:07:45 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-4086aedf-45af-450b-96c4-713d64236d40 req-9ebcee94-221c-4c74-a0be-a3078a729ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab65dfd-f2a1-4631-82a2-70a18f0f33f7", "name": "network-vif-plugged", "status": "completed", "tag": "7c974323-9ad0-4786-b46b-27b6d54a612b"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:07:45 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-4086aedf-45af-450b-96c4-713d64236d40 req-9ebcee94-221c-4c74-a0be-a3078a729ad0 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:45 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-4086aedf-45af-450b-96c4-713d64236d40 req-9ebcee94-221c-4c74-a0be-a3078a729ad0 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:45 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-4086aedf-45af-450b-96c4-713d64236d40 req-9ebcee94-221c-4c74-a0be-a3078a729ad0 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:45 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-4086aedf-45af-450b-96c4-713d64236d40 req-9ebcee94-221c-4c74-a0be-a3078a729ad0 service nova] Creating event network-vif-plugged:7c974323-9ad0-4786-b46b-27b6d54a612b for instance dab65dfd-f2a1-4631-82a2-70a18f0f33f7 on user Apr 14 19:07:45 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-4086aedf-45af-450b-96c4-713d64236d40 req-9ebcee94-221c-4c74-a0be-a3078a729ad0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030166 Apr 14 19:07:45 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 338/1005] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:07:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:07:47 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-f8bd7a9a-c6ce-4a21-a6bf-83b338b07fb1 req-d076580b-f9cb-443c-b90a-6c28b83099cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab65dfd-f2a1-4631-82a2-70a18f0f33f7", "name": "network-vif-plugged", "status": "completed", "tag": "7c974323-9ad0-4786-b46b-27b6d54a612b"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:07:47 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-f8bd7a9a-c6ce-4a21-a6bf-83b338b07fb1 req-d076580b-f9cb-443c-b90a-6c28b83099cb service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:47 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-f8bd7a9a-c6ce-4a21-a6bf-83b338b07fb1 req-d076580b-f9cb-443c-b90a-6c28b83099cb service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:47 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-f8bd7a9a-c6ce-4a21-a6bf-83b338b07fb1 req-d076580b-f9cb-443c-b90a-6c28b83099cb service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:47 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-f8bd7a9a-c6ce-4a21-a6bf-83b338b07fb1 req-d076580b-f9cb-443c-b90a-6c28b83099cb service nova] Creating event network-vif-plugged:7c974323-9ad0-4786-b46b-27b6d54a612b for instance dab65dfd-f2a1-4631-82a2-70a18f0f33f7 on user Apr 14 19:07:47 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-f8bd7a9a-c6ce-4a21-a6bf-83b338b07fb1 req-d076580b-f9cb-443c-b90a-6c28b83099cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032303 Apr 14 19:07:47 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 333/1006] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:07:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:07:58 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-799120a6-47bc-4b57-b7a6-0f0493eab6a6 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:07:58 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-799120a6-47bc-4b57-b7a6-0f0493eab6a6 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:07:58 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:07:58 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:07:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-799120a6-47bc-4b57-b7a6-0f0493eab6a6 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-799120a6-47bc-4b57-b7a6-0f0493eab6a6 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-799120a6-47bc-4b57-b7a6-0f0493eab6a6 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-799120a6-47bc-4b57-b7a6-0f0493eab6a6 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:07:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-799120a6-47bc-4b57-b7a6-0f0493eab6a6 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:07:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-799120a6-47bc-4b57-b7a6-0f0493eab6a6 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:07:58 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-799120a6-47bc-4b57-b7a6-0f0493eab6a6 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050739 Apr 14 19:07:58 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 336/1007] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 19:07:58 2023] GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 19:08:00 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:08:00 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=6 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:08:00 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:08:00 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=4 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:08:00 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-82bf4ae3-e3da-439f-85d0-35d67cca3282 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:08:00 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-82bf4ae3-e3da-439f-85d0-35d67cca3282 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:08:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-82bf4ae3-e3da-439f-85d0-35d67cca3282 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:08:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-82bf4ae3-e3da-439f-85d0-35d67cca3282 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:08:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-82bf4ae3-e3da-439f-85d0-35d67cca3282 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:08:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-82bf4ae3-e3da-439f-85d0-35d67cca3282 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:08:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-82bf4ae3-e3da-439f-85d0-35d67cca3282 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:08:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-82bf4ae3-e3da-439f-85d0-35d67cca3282 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:08:00 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-82bf4ae3-e3da-439f-85d0-35d67cca3282 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:08:00 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-82bf4ae3-e3da-439f-85d0-35d67cca3282 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/935022b4-4ba7-4b34-a758-a00081240b4c" status: 200 len: 1440 microversion: 2.1 time: 0.243161 Apr 14 19:08:00 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 339/1008] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:08:00 2023] GET /compute/v2.1/servers/935022b4-4ba7-4b34-a758-a00081240b4c => generated 1440 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:08:02 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:08:02 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=6 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:08:02 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:08:02 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "181629c0-20ac-42f2-a3c3-25e9feeda169"}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:08:02 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:08:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:08:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:08:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:08:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:08:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:08:02 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:08:02 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.330452 Apr 14 19:08:02 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 334/1009] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 19:08:02 2023] POST /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:08:04 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-1ab59a4a-f3bf-4956-9bec-7c7f1c2a1b95 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:08:04 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-1ab59a4a-f3bf-4956-9bec-7c7f1c2a1b95 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:08:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1ab59a4a-f3bf-4956-9bec-7c7f1c2a1b95 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:08:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1ab59a4a-f3bf-4956-9bec-7c7f1c2a1b95 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:08:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1ab59a4a-f3bf-4956-9bec-7c7f1c2a1b95 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:08:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1ab59a4a-f3bf-4956-9bec-7c7f1c2a1b95 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:08:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1ab59a4a-f3bf-4956-9bec-7c7f1c2a1b95 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:08:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-1ab59a4a-f3bf-4956-9bec-7c7f1c2a1b95 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:08:05 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-1ab59a4a-f3bf-4956-9bec-7c7f1c2a1b95 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:08:05 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-1ab59a4a-f3bf-4956-9bec-7c7f1c2a1b95 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:08:05 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-1ab59a4a-f3bf-4956-9bec-7c7f1c2a1b95 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:08:05 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-1ab59a4a-f3bf-4956-9bec-7c7f1c2a1b95 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a" status: 200 len: 1784 microversion: 2.20 time: 0.267848 Apr 14 19:08:05 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 337/1010] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:08:04 2023] GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a => generated 1784 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 19:08:10 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:08:10 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:08:10 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:08:10 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:08:10 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:08:10 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:08:10 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:08:10 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:08:10 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:08:11 user devstack@n-api.service[61674]: DEBUG nova.objects.instance [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lazy-loading 'services' on Instance uuid a9379580-fd2f-4468-9ed3-7109735195be {{(pid=61674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 19:08:11 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments/181629c0-20ac-42f2-a3c3-25e9feeda169" status: 202 len: 0 microversion: 2.1 time: 0.163514 Apr 14 19:08:11 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 340/1011] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 19:08:10 2023] DELETE /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments/181629c0-20ac-42f2-a3c3-25e9feeda169 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 19:08:11 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-90b4d575-b33b-49e7-b62a-153846a65671 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:08:11 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-90b4d575-b33b-49e7-b62a-153846a65671 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:08:11 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-90b4d575-b33b-49e7-b62a-153846a65671 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:08:11 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-90b4d575-b33b-49e7-b62a-153846a65671 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:08:11 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-90b4d575-b33b-49e7-b62a-153846a65671 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:08:11 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-90b4d575-b33b-49e7-b62a-153846a65671 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:08:11 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-90b4d575-b33b-49e7-b62a-153846a65671 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:08:11 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-90b4d575-b33b-49e7-b62a-153846a65671 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:08:11 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-90b4d575-b33b-49e7-b62a-153846a65671 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051682 Apr 14 19:08:11 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 335/1012] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 19:08:11 2023] GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:08:16 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-ad6337aa-c215-411e-9f1a-f9d0b080d932 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:08:16 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-ad6337aa-c215-411e-9f1a-f9d0b080d932 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:08:16 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=4 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:08:16 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=12 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:08:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ad6337aa-c215-411e-9f1a-f9d0b080d932 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:08:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ad6337aa-c215-411e-9f1a-f9d0b080d932 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:08:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ad6337aa-c215-411e-9f1a-f9d0b080d932 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:08:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ad6337aa-c215-411e-9f1a-f9d0b080d932 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:08:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ad6337aa-c215-411e-9f1a-f9d0b080d932 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:08:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-ad6337aa-c215-411e-9f1a-f9d0b080d932 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:08:16 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-ad6337aa-c215-411e-9f1a-f9d0b080d932 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] HTTP exception thrown: Instance 1d305ab4-1813-4728-a01c-287e521a05ec could not be found. Apr 14 19:08:16 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-ad6337aa-c215-411e-9f1a-f9d0b080d932 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Request method failure captured: Apr 14 19:08:16 user devstack@n-api.service[61675]: request: GET /compute/v2.1/servers/1d305ab4-1813-4728-a01c-287e521a05ec HTTP/1.1 Apr 14 19:08:16 user devstack@n-api.service[61675]: Accept: application/json Apr 14 19:08:16 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 19:08:16 user devstack@n-api.service[61675]: Connection: close Apr 14 19:08:16 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 19:08:16 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 19:08:16 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 19:08:16 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 19:08:16 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 19:08:16 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOaBsVI_nvkyYSUnUpk_9LZivhBf1YZK5uRUFFR2iv7YLDTugI5hWoRijQ-9F1cI4hDuKdzxQWbf2lUpXfxiTO1q10jdi5iIMybz9kkHtzg_mWEjrwYVtbLI2p_4_sZODWdXkFWOQ0NLBMotwKrDrF_4nfgQcIHiwUOtMf5a-BxmB6jA Apr 14 19:08:16 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 19:08:16 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 19:08:16 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 19:08:16 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 19:08:16 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 19:08:16 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 19:08:16 user devstack@n-api.service[61675]: X-Project-Id: e60e8abd123e414f847c68ba72894689 Apr 14 19:08:16 user devstack@n-api.service[61675]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1174646715 Apr 14 19:08:16 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 19:08:16 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 19:08:16 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e60e8abd123e414f847c68ba72894689"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e60e8abd123e414f847c68ba72894689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e60e8abd123e414f847c68ba72894689"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:08:16 user devstack@n-api.service[61675]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1174646715 Apr 14 19:08:16 user devstack@n-api.service[61675]: X-Tenant-Id: e60e8abd123e414f847c68ba72894689 Apr 14 19:08:16 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1174646715 Apr 14 19:08:16 user devstack@n-api.service[61675]: X-User: tempest-ServerRescueNegativeTestJSON-1174646715-project-member Apr 14 19:08:16 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 19:08:16 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 19:08:16 user devstack@n-api.service[61675]: X-User-Id: c8713ed85ffb4446847f5ded4bc2e399 Apr 14 19:08:16 user devstack@n-api.service[61675]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1174646715-project-member Apr 14 19:08:16 user devstack@n-api.service[61675]: method: > Apr 14 19:08:16 user devstack@n-api.service[61675]: exception: Instance 1d305ab4-1813-4728-a01c-287e521a05ec could not be found. Apr 14 19:08:16 user devstack@n-api.service[61675]: action_args: {'id': '1d305ab4-1813-4728-a01c-287e521a05ec'} Apr 14 19:08:16 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d305ab4-1813-4728-a01c-287e521a05ec could not be found. Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d305ab4-1813-4728-a01c-287e521a05ec could not be found. Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d305ab4-1813-4728-a01c-287e521a05ec could not be found. Apr 14 19:08:16 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:08:16 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-ad6337aa-c215-411e-9f1a-f9d0b080d932 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Returning 404 to user: Instance 1d305ab4-1813-4728-a01c-287e521a05ec could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:08:16 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-ad6337aa-c215-411e-9f1a-f9d0b080d932 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1d305ab4-1813-4728-a01c-287e521a05ec" status: 404 len: 111 microversion: 2.1 time: 0.236392 Apr 14 19:08:16 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 338/1013] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:08:16 2023] GET /compute/v2.1/servers/1d305ab4-1813-4728-a01c-287e521a05ec => generated 111 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:08:20 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-9e22d65b-c060-4e83-9191-4ca262fafa2d tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] Action: 'create', calling method: .version_select at 0x7fdae0f3e8c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1081423261", "metadata": {"Type": "work"}}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:08:20 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-9e22d65b-c060-4e83-9191-4ca262fafa2d tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] Request method failure captured: Apr 14 19:08:20 user devstack@n-api.service[61674]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 19:08:20 user devstack@n-api.service[61674]: Accept: application/json Apr 14 19:08:20 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 19:08:20 user devstack@n-api.service[61674]: Connection: close Apr 14 19:08:20 user devstack@n-api.service[61674]: Content-Length: 122 Apr 14 19:08:20 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 19:08:20 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 19:08:20 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 19:08:20 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOaSj2pbTlpP8D6s_oRIBcGfgDHWHjOfkMdTai5jIbna6Y0Kkc9mm-nhEQQtmiotfucMK6m-CQBEzeTsU4edoc2grYwYm6c9DoIIbcPLAM-Q4FlEnJBV7790a3fhzs6MWAQmsEUR88EVkRbVlDWdmf7vGvcnVzqnaBNx01cjO4iS5a0k Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Project-Id: b43abf1d49c8498397b11cf2c6d8d0e5 Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Project-Name: tempest-VolumesNegativeTest-279081997 Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b43abf1d49c8498397b11cf2c6d8d0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b43abf1d49c8498397b11cf2c6d8d0e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b43abf1d49c8498397b11cf2c6d8d0e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Tenant: tempest-VolumesNegativeTest-279081997 Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Tenant-Id: b43abf1d49c8498397b11cf2c6d8d0e5 Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-VolumesNegativeTest-279081997 Apr 14 19:08:20 user devstack@n-api.service[61674]: X-User: tempest-VolumesNegativeTest-279081997-project-member Apr 14 19:08:20 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 19:08:20 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 19:08:20 user devstack@n-api.service[61674]: X-User-Id: 286efe7d1d17428a8095b7833eade5e1 Apr 14 19:08:20 user devstack@n-api.service[61674]: X-User-Name: tempest-VolumesNegativeTest-279081997-project-member Apr 14 19:08:20 user devstack@n-api.service[61674]: Apr 14 19:08:20 user devstack@n-api.service[61674]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1081423261", "metadata": {"Type": "work"}}} Apr 14 19:08:20 user devstack@n-api.service[61674]: method: Apr 14 19:08:20 user devstack@n-api.service[61674]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 19:08:20 user devstack@n-api.service[61674]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1081423261', 'metadata': {'Type': 'work'}}}} Apr 14 19:08:20 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise error Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi '#$%' Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-9e22d65b-c060-4e83-9191-4ca262fafa2d tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:08:20 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-9e22d65b-c060-4e83-9191-4ca262fafa2d tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.173543 Apr 14 19:08:20 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 341/1014] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 19:08:20 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 19:08:20 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-fc135eb3-8a77-4e26-b474-58deb2fac116 tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] Action: 'create', calling method: .version_select at 0x7fdae1266560>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-121120689", "metadata": {"Type": "work"}}} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:08:20 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-fc135eb3-8a77-4e26-b474-58deb2fac116 tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] Request method failure captured: Apr 14 19:08:20 user devstack@n-api.service[61673]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 19:08:20 user devstack@n-api.service[61673]: Accept: application/json Apr 14 19:08:20 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 19:08:20 user devstack@n-api.service[61673]: Connection: close Apr 14 19:08:20 user devstack@n-api.service[61673]: Content-Length: 119 Apr 14 19:08:20 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 19:08:20 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 19:08:20 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 19:08:20 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOaSj2pbTlpP8D6s_oRIBcGfgDHWHjOfkMdTai5jIbna6Y0Kkc9mm-nhEQQtmiotfucMK6m-CQBEzeTsU4edoc2grYwYm6c9DoIIbcPLAM-Q4FlEnJBV7790a3fhzs6MWAQmsEUR88EVkRbVlDWdmf7vGvcnVzqnaBNx01cjO4iS5a0k Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Project-Id: b43abf1d49c8498397b11cf2c6d8d0e5 Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Project-Name: tempest-VolumesNegativeTest-279081997 Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b43abf1d49c8498397b11cf2c6d8d0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b43abf1d49c8498397b11cf2c6d8d0e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b43abf1d49c8498397b11cf2c6d8d0e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Tenant: tempest-VolumesNegativeTest-279081997 Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Tenant-Id: b43abf1d49c8498397b11cf2c6d8d0e5 Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-VolumesNegativeTest-279081997 Apr 14 19:08:20 user devstack@n-api.service[61673]: X-User: tempest-VolumesNegativeTest-279081997-project-member Apr 14 19:08:20 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 19:08:20 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 19:08:20 user devstack@n-api.service[61673]: X-User-Id: 286efe7d1d17428a8095b7833eade5e1 Apr 14 19:08:20 user devstack@n-api.service[61673]: X-User-Name: tempest-VolumesNegativeTest-279081997-project-member Apr 14 19:08:20 user devstack@n-api.service[61673]: Apr 14 19:08:20 user devstack@n-api.service[61673]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-121120689", "metadata": {"Type": "work"}}} Apr 14 19:08:20 user devstack@n-api.service[61673]: method: Apr 14 19:08:20 user devstack@n-api.service[61673]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 19:08:20 user devstack@n-api.service[61673]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-121120689', 'metadata': {'Type': 'work'}}}} Apr 14 19:08:20 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise error Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi '0' Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-fc135eb3-8a77-4e26-b474-58deb2fac116 tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:08:20 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-fc135eb3-8a77-4e26-b474-58deb2fac116 tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.026137 Apr 14 19:08:20 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 336/1015] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 19:08:20 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 19:08:20 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-cd81ce35-c538-4bcb-ae96-b6795cfb8f93 tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] Action: 'create', calling method: .version_select at 0x7fdae0e03010>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-791196075", "metadata": {"Type": "work"}}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:08:20 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-cd81ce35-c538-4bcb-ae96-b6795cfb8f93 tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] Request method failure captured: Apr 14 19:08:20 user devstack@n-api.service[61675]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 19:08:20 user devstack@n-api.service[61675]: Accept: application/json Apr 14 19:08:20 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 19:08:20 user devstack@n-api.service[61675]: Connection: close Apr 14 19:08:20 user devstack@n-api.service[61675]: Content-Length: 118 Apr 14 19:08:20 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 19:08:20 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 19:08:20 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 19:08:20 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 19:08:20 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOaSj2pbTlpP8D6s_oRIBcGfgDHWHjOfkMdTai5jIbna6Y0Kkc9mm-nhEQQtmiotfucMK6m-CQBEzeTsU4edoc2grYwYm6c9DoIIbcPLAM-Q4FlEnJBV7790a3fhzs6MWAQmsEUR88EVkRbVlDWdmf7vGvcnVzqnaBNx01cjO4iS5a0k Apr 14 19:08:20 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 19:08:20 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 19:08:20 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 19:08:20 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 19:08:20 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 19:08:20 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 19:08:20 user devstack@n-api.service[61675]: X-Project-Id: b43abf1d49c8498397b11cf2c6d8d0e5 Apr 14 19:08:20 user devstack@n-api.service[61675]: X-Project-Name: tempest-VolumesNegativeTest-279081997 Apr 14 19:08:20 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 19:08:20 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 19:08:20 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b43abf1d49c8498397b11cf2c6d8d0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b43abf1d49c8498397b11cf2c6d8d0e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b43abf1d49c8498397b11cf2c6d8d0e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:08:20 user devstack@n-api.service[61675]: X-Tenant: tempest-VolumesNegativeTest-279081997 Apr 14 19:08:20 user devstack@n-api.service[61675]: X-Tenant-Id: b43abf1d49c8498397b11cf2c6d8d0e5 Apr 14 19:08:20 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-VolumesNegativeTest-279081997 Apr 14 19:08:20 user devstack@n-api.service[61675]: X-User: tempest-VolumesNegativeTest-279081997-project-member Apr 14 19:08:20 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 19:08:20 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 19:08:20 user devstack@n-api.service[61675]: X-User-Id: 286efe7d1d17428a8095b7833eade5e1 Apr 14 19:08:20 user devstack@n-api.service[61675]: X-User-Name: tempest-VolumesNegativeTest-279081997-project-member Apr 14 19:08:20 user devstack@n-api.service[61675]: Apr 14 19:08:20 user devstack@n-api.service[61675]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-791196075", "metadata": {"Type": "work"}}} Apr 14 19:08:20 user devstack@n-api.service[61675]: method: Apr 14 19:08:20 user devstack@n-api.service[61675]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 19:08:20 user devstack@n-api.service[61675]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-791196075', 'metadata': {'Type': 'work'}}}} Apr 14 19:08:20 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise error Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi '' Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 19:08:20 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-cd81ce35-c538-4bcb-ae96-b6795cfb8f93 tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:08:20 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-cd81ce35-c538-4bcb-ae96-b6795cfb8f93 tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009517 Apr 14 19:08:20 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 339/1016] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 19:08:20 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 19:08:20 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-ab6bc647-9eef-4348-9be5-1b62a60e7be1 tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] Calling method '.version_select at 0x7fdae1214040>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:08:20 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-ab6bc647-9eef-4348-9be5-1b62a60e7be1 tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] HTTP exception thrown: Volume tempest-invalid-45334411 could not be found. Apr 14 19:08:20 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-ab6bc647-9eef-4348-9be5-1b62a60e7be1 tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] Request method failure captured: Apr 14 19:08:20 user devstack@n-api.service[61674]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-45334411 HTTP/1.1 Apr 14 19:08:20 user devstack@n-api.service[61674]: Accept: application/json Apr 14 19:08:20 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 19:08:20 user devstack@n-api.service[61674]: Connection: close Apr 14 19:08:20 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 19:08:20 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 19:08:20 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 19:08:20 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 19:08:20 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOaSj2pbTlpP8D6s_oRIBcGfgDHWHjOfkMdTai5jIbna6Y0Kkc9mm-nhEQQtmiotfucMK6m-CQBEzeTsU4edoc2grYwYm6c9DoIIbcPLAM-Q4FlEnJBV7790a3fhzs6MWAQmsEUR88EVkRbVlDWdmf7vGvcnVzqnaBNx01cjO4iS5a0k Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Project-Id: b43abf1d49c8498397b11cf2c6d8d0e5 Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Project-Name: tempest-VolumesNegativeTest-279081997 Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b43abf1d49c8498397b11cf2c6d8d0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b43abf1d49c8498397b11cf2c6d8d0e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b43abf1d49c8498397b11cf2c6d8d0e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Tenant: tempest-VolumesNegativeTest-279081997 Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Tenant-Id: b43abf1d49c8498397b11cf2c6d8d0e5 Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-VolumesNegativeTest-279081997 Apr 14 19:08:20 user devstack@n-api.service[61674]: X-User: tempest-VolumesNegativeTest-279081997-project-member Apr 14 19:08:20 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 19:08:20 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 19:08:20 user devstack@n-api.service[61674]: X-User-Id: 286efe7d1d17428a8095b7833eade5e1 Apr 14 19:08:20 user devstack@n-api.service[61674]: X-User-Name: tempest-VolumesNegativeTest-279081997-project-member Apr 14 19:08:20 user devstack@n-api.service[61674]: method: Apr 14 19:08:20 user devstack@n-api.service[61674]: exception: Volume tempest-invalid-45334411 could not be found. Apr 14 19:08:20 user devstack@n-api.service[61674]: action_args: {'id': 'tempest-invalid-45334411'} Apr 14 19:08:20 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-45334411 could not be found. (HTTP 404) (Request-ID: req-e8dce43f-0a7d-40cb-a5c9-7d1d853cbc4a) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-45334411 could not be found. Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-45334411 could not be found. Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-45334411 could not be found. Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-ab6bc647-9eef-4348-9be5-1b62a60e7be1 tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] Returning 404 to user: Volume tempest-invalid-45334411 could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:08:20 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-ab6bc647-9eef-4348-9be5-1b62a60e7be1 tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-45334411" status: 404 len: 97 microversion: 2.1 time: 0.037425 Apr 14 19:08:20 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 342/1017] 10.0.0.210 () {62 vars in 1289 bytes} [Fri Apr 14 19:08:20 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-45334411 => generated 97 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 14 19:08:20 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-837cfb35-e0e3-4492-926b-2b30cecaa8fe tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006226 Apr 14 19:08:20 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 337/1018] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 14 19:08:20 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 14 19:08:20 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-41c3b4f4-6056-45fb-90a7-4712f3ed628c tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007735 Apr 14 19:08:20 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 340/1019] 10.0.0.210 () {62 vars in 1214 bytes} [Fri Apr 14 19:08:20 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 14 19:08:20 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-59e6b3e1-6479-47ae-a532-bcc60bdabc5f tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] Calling method '.version_select at 0x7fdae0f3f400>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:08:20 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-59e6b3e1-6479-47ae-a532-bcc60bdabc5f tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] HTTP exception thrown: Volume 3876f2fd-3cd5-4e24-9dca-00de7c33ed78 could not be found. Apr 14 19:08:20 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-59e6b3e1-6479-47ae-a532-bcc60bdabc5f tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] Request method failure captured: Apr 14 19:08:20 user devstack@n-api.service[61674]: request: DELETE /compute/v2.1/os-volumes/3876f2fd-3cd5-4e24-9dca-00de7c33ed78 HTTP/1.1 Apr 14 19:08:20 user devstack@n-api.service[61674]: Accept: application/json Apr 14 19:08:20 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 19:08:20 user devstack@n-api.service[61674]: Connection: close Apr 14 19:08:20 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 19:08:20 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 19:08:20 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 19:08:20 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 19:08:20 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOaSj2pbTlpP8D6s_oRIBcGfgDHWHjOfkMdTai5jIbna6Y0Kkc9mm-nhEQQtmiotfucMK6m-CQBEzeTsU4edoc2grYwYm6c9DoIIbcPLAM-Q4FlEnJBV7790a3fhzs6MWAQmsEUR88EVkRbVlDWdmf7vGvcnVzqnaBNx01cjO4iS5a0k Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Project-Id: b43abf1d49c8498397b11cf2c6d8d0e5 Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Project-Name: tempest-VolumesNegativeTest-279081997 Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b43abf1d49c8498397b11cf2c6d8d0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b43abf1d49c8498397b11cf2c6d8d0e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b43abf1d49c8498397b11cf2c6d8d0e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Tenant: tempest-VolumesNegativeTest-279081997 Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Tenant-Id: b43abf1d49c8498397b11cf2c6d8d0e5 Apr 14 19:08:20 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-VolumesNegativeTest-279081997 Apr 14 19:08:20 user devstack@n-api.service[61674]: X-User: tempest-VolumesNegativeTest-279081997-project-member Apr 14 19:08:20 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 19:08:20 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 19:08:20 user devstack@n-api.service[61674]: X-User-Id: 286efe7d1d17428a8095b7833eade5e1 Apr 14 19:08:20 user devstack@n-api.service[61674]: X-User-Name: tempest-VolumesNegativeTest-279081997-project-member Apr 14 19:08:20 user devstack@n-api.service[61674]: method: Apr 14 19:08:20 user devstack@n-api.service[61674]: exception: Volume 3876f2fd-3cd5-4e24-9dca-00de7c33ed78 could not be found. Apr 14 19:08:20 user devstack@n-api.service[61674]: action_args: {'id': '3876f2fd-3cd5-4e24-9dca-00de7c33ed78'} Apr 14 19:08:20 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3876f2fd-3cd5-4e24-9dca-00de7c33ed78 could not be found. (HTTP 404) (Request-ID: req-caba6a3f-3e4a-4664-ba33-c35b9b728851) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3876f2fd-3cd5-4e24-9dca-00de7c33ed78 could not be found. Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3876f2fd-3cd5-4e24-9dca-00de7c33ed78 could not be found. Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3876f2fd-3cd5-4e24-9dca-00de7c33ed78 could not be found. Apr 14 19:08:20 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-59e6b3e1-6479-47ae-a532-bcc60bdabc5f tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] Returning 404 to user: Volume 3876f2fd-3cd5-4e24-9dca-00de7c33ed78 could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:08:20 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-59e6b3e1-6479-47ae-a532-bcc60bdabc5f tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/3876f2fd-3cd5-4e24-9dca-00de7c33ed78" status: 404 len: 109 microversion: 2.1 time: 0.037533 Apr 14 19:08:20 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 343/1020] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 19:08:20 2023] DELETE /compute/v2.1/os-volumes/3876f2fd-3cd5-4e24-9dca-00de7c33ed78 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:08:20 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-5d30cca4-5777-4bd8-b914-f3defeb63770 tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] Calling method '.version_select at 0x7fdae137f9a0>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:08:20 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-5d30cca4-5777-4bd8-b914-f3defeb63770 tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] HTTP exception thrown: Volume 8408e626-7315-4186-a535-7c5c3bcbf4d5 could not be found. Apr 14 19:08:20 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-5d30cca4-5777-4bd8-b914-f3defeb63770 tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] Request method failure captured: Apr 14 19:08:20 user devstack@n-api.service[61673]: request: GET /compute/v2.1/os-volumes/8408e626-7315-4186-a535-7c5c3bcbf4d5 HTTP/1.1 Apr 14 19:08:20 user devstack@n-api.service[61673]: Accept: application/json Apr 14 19:08:20 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 19:08:20 user devstack@n-api.service[61673]: Connection: close Apr 14 19:08:20 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 19:08:20 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 19:08:20 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 19:08:20 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 19:08:20 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOaSj2pbTlpP8D6s_oRIBcGfgDHWHjOfkMdTai5jIbna6Y0Kkc9mm-nhEQQtmiotfucMK6m-CQBEzeTsU4edoc2grYwYm6c9DoIIbcPLAM-Q4FlEnJBV7790a3fhzs6MWAQmsEUR88EVkRbVlDWdmf7vGvcnVzqnaBNx01cjO4iS5a0k Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Project-Id: b43abf1d49c8498397b11cf2c6d8d0e5 Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Project-Name: tempest-VolumesNegativeTest-279081997 Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b43abf1d49c8498397b11cf2c6d8d0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b43abf1d49c8498397b11cf2c6d8d0e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b43abf1d49c8498397b11cf2c6d8d0e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Tenant: tempest-VolumesNegativeTest-279081997 Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Tenant-Id: b43abf1d49c8498397b11cf2c6d8d0e5 Apr 14 19:08:20 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-VolumesNegativeTest-279081997 Apr 14 19:08:20 user devstack@n-api.service[61673]: X-User: tempest-VolumesNegativeTest-279081997-project-member Apr 14 19:08:20 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 19:08:20 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 19:08:20 user devstack@n-api.service[61673]: X-User-Id: 286efe7d1d17428a8095b7833eade5e1 Apr 14 19:08:20 user devstack@n-api.service[61673]: X-User-Name: tempest-VolumesNegativeTest-279081997-project-member Apr 14 19:08:20 user devstack@n-api.service[61673]: method: Apr 14 19:08:20 user devstack@n-api.service[61673]: exception: Volume 8408e626-7315-4186-a535-7c5c3bcbf4d5 could not be found. Apr 14 19:08:20 user devstack@n-api.service[61673]: action_args: {'id': '8408e626-7315-4186-a535-7c5c3bcbf4d5'} Apr 14 19:08:20 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8408e626-7315-4186-a535-7c5c3bcbf4d5 could not be found. (HTTP 404) (Request-ID: req-70bbdc8e-fe66-4957-9e0b-1fa22a61c4ed) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8408e626-7315-4186-a535-7c5c3bcbf4d5 could not be found. Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8408e626-7315-4186-a535-7c5c3bcbf4d5 could not be found. Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8408e626-7315-4186-a535-7c5c3bcbf4d5 could not be found. Apr 14 19:08:20 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:08:20 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-5d30cca4-5777-4bd8-b914-f3defeb63770 tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] Returning 404 to user: Volume 8408e626-7315-4186-a535-7c5c3bcbf4d5 could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:08:20 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-5d30cca4-5777-4bd8-b914-f3defeb63770 tempest-VolumesNegativeTest-279081997 tempest-VolumesNegativeTest-279081997-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8408e626-7315-4186-a535-7c5c3bcbf4d5" status: 404 len: 109 microversion: 2.1 time: 0.049438 Apr 14 19:08:20 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 338/1021] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 19:08:20 2023] GET /compute/v2.1/os-volumes/8408e626-7315-4186-a535-7c5c3bcbf4d5 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:08:24 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:08:24 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:08:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:08:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:08:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:08:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:08:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:08:24 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:08:24 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Going to try to terminate instance {{(pid=61675) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 19:08:24 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468" status: 204 len: 0 microversion: 2.1 time: 0.115060 Apr 14 19:08:24 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 341/1022] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:08:24 2023] DELETE /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 19:08:25 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:08:25 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:08:25 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-baa29735-0b9e-4fff-8b8f-418529439a48 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:08:25 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-baa29735-0b9e-4fff-8b8f-418529439a48 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:08:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-baa29735-0b9e-4fff-8b8f-418529439a48 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:08:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-baa29735-0b9e-4fff-8b8f-418529439a48 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:08:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-baa29735-0b9e-4fff-8b8f-418529439a48 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:08:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-baa29735-0b9e-4fff-8b8f-418529439a48 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:08:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-baa29735-0b9e-4fff-8b8f-418529439a48 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:08:25 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-baa29735-0b9e-4fff-8b8f-418529439a48 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:08:25 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=4 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:08:25 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:08:25 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-d1981819-9d88-49a4-b5a9-78ad71e07043 req-9321e2f6-35e2-4d46-8497-aaef51c64ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4a54fb1-bd66-42f5-9f8c-9fb40470f468", "name": "network-vif-unplugged", "status": "completed", "tag": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:08:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-d1981819-9d88-49a4-b5a9-78ad71e07043 req-9321e2f6-35e2-4d46-8497-aaef51c64ed6 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:08:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-d1981819-9d88-49a4-b5a9-78ad71e07043 req-9321e2f6-35e2-4d46-8497-aaef51c64ed6 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:08:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-d1981819-9d88-49a4-b5a9-78ad71e07043 req-9321e2f6-35e2-4d46-8497-aaef51c64ed6 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:08:25 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-d1981819-9d88-49a4-b5a9-78ad71e07043 req-9321e2f6-35e2-4d46-8497-aaef51c64ed6 service nova] Creating event network-vif-unplugged:bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 for instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 on user Apr 14 19:08:25 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-d1981819-9d88-49a4-b5a9-78ad71e07043 req-9321e2f6-35e2-4d46-8497-aaef51c64ed6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040726 Apr 14 19:08:25 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 339/1023] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:08:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:08:25 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-baa29735-0b9e-4fff-8b8f-418529439a48 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:08:25 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-baa29735-0b9e-4fff-8b8f-418529439a48 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468" status: 200 len: 1552 microversion: 2.1 time: 0.476676 Apr 14 19:08:25 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 344/1024] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:08:24 2023] GET /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468 => generated 1552 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:08:27 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-c50ee20b-fc37-4ae0-ab36-e01d3a50baa8 req-cbdf170c-e335-460b-a4cc-37dead1db44e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4a54fb1-bd66-42f5-9f8c-9fb40470f468", "name": "network-vif-deleted", "tag": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:08:27 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-c50ee20b-fc37-4ae0-ab36-e01d3a50baa8 req-cbdf170c-e335-460b-a4cc-37dead1db44e service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:08:27 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-c50ee20b-fc37-4ae0-ab36-e01d3a50baa8 req-cbdf170c-e335-460b-a4cc-37dead1db44e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:08:27 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-c50ee20b-fc37-4ae0-ab36-e01d3a50baa8 req-cbdf170c-e335-460b-a4cc-37dead1db44e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:08:27 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-c50ee20b-fc37-4ae0-ab36-e01d3a50baa8 req-cbdf170c-e335-460b-a4cc-37dead1db44e service nova] Creating event network-vif-deleted:bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 for instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 on user Apr 14 19:08:27 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-c50ee20b-fc37-4ae0-ab36-e01d3a50baa8 req-cbdf170c-e335-460b-a4cc-37dead1db44e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029790 Apr 14 19:08:27 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 342/1025] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:08:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:08:27 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-b1cb4e50-23ee-4746-8e1e-c851ab534565 req-ed863f3c-5677-4f2c-9149-e8a34b1f5ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4a54fb1-bd66-42f5-9f8c-9fb40470f468", "name": "network-vif-plugged", "status": "completed", "tag": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:08:27 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-b1cb4e50-23ee-4746-8e1e-c851ab534565 req-ed863f3c-5677-4f2c-9149-e8a34b1f5ca4 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:08:27 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-b1cb4e50-23ee-4746-8e1e-c851ab534565 req-ed863f3c-5677-4f2c-9149-e8a34b1f5ca4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:08:27 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-b1cb4e50-23ee-4746-8e1e-c851ab534565 req-ed863f3c-5677-4f2c-9149-e8a34b1f5ca4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:08:27 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-b1cb4e50-23ee-4746-8e1e-c851ab534565 req-ed863f3c-5677-4f2c-9149-e8a34b1f5ca4 service nova] Creating event network-vif-plugged:bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 for instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 on user Apr 14 19:08:27 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-b1cb4e50-23ee-4746-8e1e-c851ab534565 req-ed863f3c-5677-4f2c-9149-e8a34b1f5ca4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034816 Apr 14 19:08:27 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 340/1026] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:08:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:08:31 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-ad42a4d6-4d2e-4eb1-b327-15b22477c0b7 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:08:31 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-ad42a4d6-4d2e-4eb1-b327-15b22477c0b7 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:08:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ad42a4d6-4d2e-4eb1-b327-15b22477c0b7 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:08:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ad42a4d6-4d2e-4eb1-b327-15b22477c0b7 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:08:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ad42a4d6-4d2e-4eb1-b327-15b22477c0b7 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:08:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ad42a4d6-4d2e-4eb1-b327-15b22477c0b7 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:08:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ad42a4d6-4d2e-4eb1-b327-15b22477c0b7 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:08:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ad42a4d6-4d2e-4eb1-b327-15b22477c0b7 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:08:31 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-ad42a4d6-4d2e-4eb1-b327-15b22477c0b7 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1b6efb65b541ef992b66d9d06bd03f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f71b0490e5a4d3b9300dc510b936a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:08:31 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-ad42a4d6-4d2e-4eb1-b327-15b22477c0b7 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dab65dfd-f2a1-4631-82a2-70a18f0f33f7" status: 200 len: 1485 microversion: 2.1 time: 0.239487 Apr 14 19:08:31 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 345/1027] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:08:31 2023] GET /compute/v2.1/servers/dab65dfd-f2a1-4631-82a2-70a18f0f33f7 => generated 1485 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:08:56 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:08:56 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:08:56 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-925939041", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:08:56 user devstack@n-api.service[61675]: DEBUG nova.network.neutron [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] validate_networks() for None {{(pid=61675) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 19:08:57 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Flavor limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 19:08:57 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Image limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 19:08:57 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Flavor pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 19:08:57 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Image pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 19:08:57 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 19:08:57 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:08:57 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:08:57 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:08:57 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:08:57 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:08:57 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:08:57 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Getting quotas for project f7ba27cb61ba410a875c07ad41d363ba. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 19:08:57 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Getting quotas for user dda4004af79e4162acea243b475c4fad and project f7ba27cb61ba410a875c07ad41d363ba. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 19:08:57 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Going to run 1 instances... {{(pid=61675) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 19:08:57 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 19:08:57 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.417389 Apr 14 19:08:57 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 343/1028] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 19:08:56 2023] POST /compute/v2.1/servers => generated 378 bytes in 420 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 19:08:57 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=4 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:08:57 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=4 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:08:57 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-41591eb8-219c-4584-9c2b-df06b5da270e tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:08:57 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-41591eb8-219c-4584-9c2b-df06b5da270e tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:08:57 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-41591eb8-219c-4584-9c2b-df06b5da270e tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda4004af79e4162acea243b475c4fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ba27cb61ba410a875c07ad41d363ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:08:57 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-41591eb8-219c-4584-9c2b-df06b5da270e tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fd6574c-2f67-46a9-838d-81f125c01b13" status: 200 len: 1208 microversion: 2.1 time: 0.111920 Apr 14 19:08:57 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 341/1029] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:08:57 2023] GET /compute/v2.1/servers/0fd6574c-2f67-46a9-838d-81f125c01b13 => generated 1208 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:08:59 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-52fe5a48-ccca-4106-8b88-7cb6226c8f22 req-d03c84de-ff63-43c8-9714-42f54a6767a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fd6574c-2f67-46a9-838d-81f125c01b13", "tag": "7ac85dee-ddfb-4242-81dd-0e7b659329a8"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:08:59 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=4 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:08:59 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=12 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:08:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-52fe5a48-ccca-4106-8b88-7cb6226c8f22 req-d03c84de-ff63-43c8-9714-42f54a6767a7 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:08:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-52fe5a48-ccca-4106-8b88-7cb6226c8f22 req-d03c84de-ff63-43c8-9714-42f54a6767a7 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:08:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-52fe5a48-ccca-4106-8b88-7cb6226c8f22 req-d03c84de-ff63-43c8-9714-42f54a6767a7 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:08:59 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-52fe5a48-ccca-4106-8b88-7cb6226c8f22 req-d03c84de-ff63-43c8-9714-42f54a6767a7 service nova] Creating event network-changed:7ac85dee-ddfb-4242-81dd-0e7b659329a8 for instance 0fd6574c-2f67-46a9-838d-81f125c01b13 on user Apr 14 19:08:59 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-52fe5a48-ccca-4106-8b88-7cb6226c8f22 req-d03c84de-ff63-43c8-9714-42f54a6767a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033490 Apr 14 19:08:59 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 346/1030] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:08:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:09:01 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-206f7873-8031-4907-95c3-d45bc8ada774 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:09:01 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-206f7873-8031-4907-95c3-d45bc8ada774 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:09:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-206f7873-8031-4907-95c3-d45bc8ada774 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-206f7873-8031-4907-95c3-d45bc8ada774 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-206f7873-8031-4907-95c3-d45bc8ada774 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-206f7873-8031-4907-95c3-d45bc8ada774 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-206f7873-8031-4907-95c3-d45bc8ada774 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:01 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-206f7873-8031-4907-95c3-d45bc8ada774 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:01 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-206f7873-8031-4907-95c3-d45bc8ada774 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:09:01 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-206f7873-8031-4907-95c3-d45bc8ada774 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/935022b4-4ba7-4b34-a758-a00081240b4c" status: 200 len: 1440 microversion: 2.1 time: 0.220817 Apr 14 19:09:01 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 344/1031] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:09:01 2023] GET /compute/v2.1/servers/935022b4-4ba7-4b34-a758-a00081240b4c => generated 1440 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:09:01 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-bd628702-7abb-4107-97ce-767b3b457a9b tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:09:01 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-bd628702-7abb-4107-97ce-767b3b457a9b tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:09:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bd628702-7abb-4107-97ce-767b3b457a9b tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bd628702-7abb-4107-97ce-767b3b457a9b tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bd628702-7abb-4107-97ce-767b3b457a9b tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bd628702-7abb-4107-97ce-767b3b457a9b tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bd628702-7abb-4107-97ce-767b3b457a9b tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:01 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-bd628702-7abb-4107-97ce-767b3b457a9b tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:01 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-bd628702-7abb-4107-97ce-767b3b457a9b tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.210359 Apr 14 19:09:01 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 342/1032] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 19:09:01 2023] GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments => generated 25 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 19:09:02 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-c8b2a343-9024-4a12-a0bb-35d44a9ac80b req-3fc603a8-e927-4c72-a7b9-6bdd42b3dbbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd6574c-2f67-46a9-838d-81f125c01b13", "name": "network-vif-plugged", "status": "completed", "tag": "7ac85dee-ddfb-4242-81dd-0e7b659329a8"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:09:02 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-c8b2a343-9024-4a12-a0bb-35d44a9ac80b req-3fc603a8-e927-4c72-a7b9-6bdd42b3dbbb service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:02 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-c8b2a343-9024-4a12-a0bb-35d44a9ac80b req-3fc603a8-e927-4c72-a7b9-6bdd42b3dbbb service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:02 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-c8b2a343-9024-4a12-a0bb-35d44a9ac80b req-3fc603a8-e927-4c72-a7b9-6bdd42b3dbbb service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:02 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-c8b2a343-9024-4a12-a0bb-35d44a9ac80b req-3fc603a8-e927-4c72-a7b9-6bdd42b3dbbb service nova] Creating event network-vif-plugged:7ac85dee-ddfb-4242-81dd-0e7b659329a8 for instance 0fd6574c-2f67-46a9-838d-81f125c01b13 on user Apr 14 19:09:02 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-c8b2a343-9024-4a12-a0bb-35d44a9ac80b req-3fc603a8-e927-4c72-a7b9-6bdd42b3dbbb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091171 Apr 14 19:09:02 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 347/1033] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:09:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:09:02 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-340ebcd8-e13f-4b1a-9092-f9f9d7a42872 req-de81e150-b29f-4d03-a585-e596b4ade102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "935022b4-4ba7-4b34-a758-a00081240b4c", "tag": "ef166576-430e-47da-b169-915c4a0cd97c"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:09:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-340ebcd8-e13f-4b1a-9092-f9f9d7a42872 req-de81e150-b29f-4d03-a585-e596b4ade102 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-340ebcd8-e13f-4b1a-9092-f9f9d7a42872 req-de81e150-b29f-4d03-a585-e596b4ade102 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:02 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-340ebcd8-e13f-4b1a-9092-f9f9d7a42872 req-de81e150-b29f-4d03-a585-e596b4ade102 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:02 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-340ebcd8-e13f-4b1a-9092-f9f9d7a42872 req-de81e150-b29f-4d03-a585-e596b4ade102 service nova] Creating event network-changed:ef166576-430e-47da-b169-915c4a0cd97c for instance 935022b4-4ba7-4b34-a758-a00081240b4c on user Apr 14 19:09:02 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-340ebcd8-e13f-4b1a-9092-f9f9d7a42872 req-de81e150-b29f-4d03-a585-e596b4ade102 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031032 Apr 14 19:09:02 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 345/1034] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:09:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:09:04 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-936c2627-39e1-42dd-8d09-d1fde1443f99 req-975a6154-dda9-4386-adac-d9a144b1adee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd6574c-2f67-46a9-838d-81f125c01b13", "name": "network-vif-plugged", "status": "completed", "tag": "7ac85dee-ddfb-4242-81dd-0e7b659329a8"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:09:04 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-936c2627-39e1-42dd-8d09-d1fde1443f99 req-975a6154-dda9-4386-adac-d9a144b1adee service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:04 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-936c2627-39e1-42dd-8d09-d1fde1443f99 req-975a6154-dda9-4386-adac-d9a144b1adee service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:04 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-936c2627-39e1-42dd-8d09-d1fde1443f99 req-975a6154-dda9-4386-adac-d9a144b1adee service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:04 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-936c2627-39e1-42dd-8d09-d1fde1443f99 req-975a6154-dda9-4386-adac-d9a144b1adee service nova] Creating event network-vif-plugged:7ac85dee-ddfb-4242-81dd-0e7b659329a8 for instance 0fd6574c-2f67-46a9-838d-81f125c01b13 on user Apr 14 19:09:04 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-936c2627-39e1-42dd-8d09-d1fde1443f99 req-975a6154-dda9-4386-adac-d9a144b1adee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058848 Apr 14 19:09:04 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 343/1035] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:09:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:09:05 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f63993f-07b3-48ef-9b2d-c50f98c837fa"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:09:05 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:09:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:05 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-26f17acf-5c9b-45e4-a94b-9c9017cc2835 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:09:05 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-26f17acf-5c9b-45e4-a94b-9c9017cc2835 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:09:05 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-26f17acf-5c9b-45e4-a94b-9c9017cc2835 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:05 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-26f17acf-5c9b-45e4-a94b-9c9017cc2835 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:05 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-26f17acf-5c9b-45e4-a94b-9c9017cc2835 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:05 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-26f17acf-5c9b-45e4-a94b-9c9017cc2835 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:05 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-26f17acf-5c9b-45e4-a94b-9c9017cc2835 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:05 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-26f17acf-5c9b-45e4-a94b-9c9017cc2835 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:05 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-26f17acf-5c9b-45e4-a94b-9c9017cc2835 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a/os-volume_attachments/732c36bf-d3d1-437c-91f5-710fea1de62b" status: 200 len: 194 microversion: 2.20 time: 0.249593 Apr 14 19:09:05 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 348/1036] 10.0.0.210 () {64 vars in 1531 bytes} [Fri Apr 14 19:09:05 2023] GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a/os-volume_attachments/732c36bf-d3d1-437c-91f5-710fea1de62b => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 19:09:05 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307862 Apr 14 19:09:05 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 346/1037] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 19:09:05 2023] POST /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:09:05 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:09:05 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:09:05 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:05 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:05 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:05 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:05 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:05 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:05 user devstack@n-api.service[61673]: DEBUG nova.objects.instance [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lazy-loading 'services' on Instance uuid 179270ef-7866-4ee7-af13-ec3ea5e7525a {{(pid=61673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 19:09:06 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a/os-volume_attachments/732c36bf-d3d1-437c-91f5-710fea1de62b" status: 202 len: 0 microversion: 2.20 time: 0.245987 Apr 14 19:09:06 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 344/1038] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 19:09:05 2023] DELETE /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a/os-volume_attachments/732c36bf-d3d1-437c-91f5-710fea1de62b => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 19:09:06 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-ceece2ce-d625-4b6c-96fb-669c57da1966 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:09:06 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-ceece2ce-d625-4b6c-96fb-669c57da1966 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:09:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ceece2ce-d625-4b6c-96fb-669c57da1966 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ceece2ce-d625-4b6c-96fb-669c57da1966 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ceece2ce-d625-4b6c-96fb-669c57da1966 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ceece2ce-d625-4b6c-96fb-669c57da1966 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ceece2ce-d625-4b6c-96fb-669c57da1966 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ceece2ce-d625-4b6c-96fb-669c57da1966 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:06 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-ceece2ce-d625-4b6c-96fb-669c57da1966 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049082 Apr 14 19:09:06 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 349/1039] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 19:09:06 2023] GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 19:09:13 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:09:13 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=6 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:09:13 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1086325203", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-875294368", "security_groups": [{"name": "tempest-secgroup-smoke-304973525"}], "block_device_mapping_v2": [{"uuid": "430ecbd6-7688-4f04-b31b-6894390ceae7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70"}]}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:09:13 user devstack@n-api.service[61675]: DEBUG nova.network.neutron [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] validate_networks() for [('bfa4fdbb-10b3-4715-9ff2-b717d052cc70', None, None, None, None, None)] {{(pid=61675) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 19:09:13 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:09:13 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:09:13 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:09:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:13 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flavor limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 19:09:13 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Image limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 19:09:13 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flavor pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 19:09:13 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Image pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 19:09:13 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 19:09:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:13 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:13 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Getting quotas for project 72d2bf68325a4a18934a8403571c24bb. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 19:09:13 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Getting quotas for user fc3bed70703a49c8bdec2f50193c7f70 and project 72d2bf68325a4a18934a8403571c24bb. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 19:09:13 user devstack@n-api.service[61673]: DEBUG nova.objects.instance [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lazy-loading 'services' on Instance uuid a9379580-fd2f-4468-9ed3-7109735195be {{(pid=61673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 19:09:13 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Going to run 1 instances... {{(pid=61675) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 19:09:13 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='430ecbd6-7688-4f04-b31b-6894390ceae7',volume_size=None,volume_type=None)] {{(pid=61675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 19:09:13 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments/4f63993f-07b3-48ef-9b2d-c50f98c837fa" status: 202 len: 0 microversion: 2.1 time: 0.168634 Apr 14 19:09:13 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 345/1040] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 19:09:13 2023] DELETE /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments/4f63993f-07b3-48ef-9b2d-c50f98c837fa => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 19:09:13 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-e9938e2d-5467-47d6-9ccc-e686e34154a1 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:09:13 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-e9938e2d-5467-47d6-9ccc-e686e34154a1 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:09:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e9938e2d-5467-47d6-9ccc-e686e34154a1 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e9938e2d-5467-47d6-9ccc-e686e34154a1 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e9938e2d-5467-47d6-9ccc-e686e34154a1 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e9938e2d-5467-47d6-9ccc-e686e34154a1 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e9938e2d-5467-47d6-9ccc-e686e34154a1 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:13 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-e9938e2d-5467-47d6-9ccc-e686e34154a1 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:13 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-e9938e2d-5467-47d6-9ccc-e686e34154a1 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047722 Apr 14 19:09:13 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 350/1041] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 19:09:13 2023] GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:09:13 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.790447 Apr 14 19:09:13 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 347/1042] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 19:09:13 2023] POST /compute/v2.1/servers => generated 403 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 19:09:13 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-226aaf71-3644-4624-875a-12c2f3d52056 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:09:13 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-226aaf71-3644-4624-875a-12c2f3d52056 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:09:14 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-226aaf71-3644-4624-875a-12c2f3d52056 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:09:14 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-226aaf71-3644-4624-875a-12c2f3d52056 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be4d9a7a-db6a-4590-9d91-7283024477f8" status: 200 len: 1089 microversion: 2.1 time: 0.105873 Apr 14 19:09:14 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 346/1043] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:09:13 2023] GET /compute/v2.1/servers/be4d9a7a-db6a-4590-9d91-7283024477f8 => generated 1089 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:09:15 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-6728f748-90ee-40cb-b0b8-6160756cde89 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:09:15 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-6728f748-90ee-40cb-b0b8-6160756cde89 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:09:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6728f748-90ee-40cb-b0b8-6160756cde89 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6728f748-90ee-40cb-b0b8-6160756cde89 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6728f748-90ee-40cb-b0b8-6160756cde89 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6728f748-90ee-40cb-b0b8-6160756cde89 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6728f748-90ee-40cb-b0b8-6160756cde89 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6728f748-90ee-40cb-b0b8-6160756cde89 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:15 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-6728f748-90ee-40cb-b0b8-6160756cde89 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] HTTP exception thrown: Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 could not be found. Apr 14 19:09:15 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-6728f748-90ee-40cb-b0b8-6160756cde89 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Request method failure captured: Apr 14 19:09:15 user devstack@n-api.service[61674]: request: GET /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468 HTTP/1.1 Apr 14 19:09:15 user devstack@n-api.service[61674]: Accept: application/json Apr 14 19:09:15 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 19:09:15 user devstack@n-api.service[61674]: Connection: close Apr 14 19:09:15 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 19:09:15 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 19:09:15 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 19:09:15 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 19:09:15 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 19:09:15 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOZ9tFQYzH-U4RXmRE_GBoSoFEKSavu1XrGPWcT-lLfWHZbvzWQQWjWk59HjQ1Ma0lTR2YMhCPS0AAOW5m4ixuYIAB7rIJDTkb3oWnMUTJ4Uv-ETUGbIaxeHZCMtexw9UCn-fsw1BljHz-gqw0vXC9BSP_BSd7HFV75kPj8WIUaZxMdo Apr 14 19:09:15 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 19:09:15 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 19:09:15 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 19:09:15 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 19:09:15 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 19:09:15 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 19:09:15 user devstack@n-api.service[61674]: X-Project-Id: f028a79640b848228dc6e654a0eef49b Apr 14 19:09:15 user devstack@n-api.service[61674]: X-Project-Name: tempest-ServerActionsTestJSON-2112054326 Apr 14 19:09:15 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 19:09:15 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 19:09:15 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:09:15 user devstack@n-api.service[61674]: X-Tenant: tempest-ServerActionsTestJSON-2112054326 Apr 14 19:09:15 user devstack@n-api.service[61674]: X-Tenant-Id: f028a79640b848228dc6e654a0eef49b Apr 14 19:09:15 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-ServerActionsTestJSON-2112054326 Apr 14 19:09:15 user devstack@n-api.service[61674]: X-User: tempest-ServerActionsTestJSON-2112054326-project-member Apr 14 19:09:15 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 19:09:15 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 19:09:15 user devstack@n-api.service[61674]: X-User-Id: 55fa4abe2fdd48cb91f39bf8156a7793 Apr 14 19:09:15 user devstack@n-api.service[61674]: X-User-Name: tempest-ServerActionsTestJSON-2112054326-project-member Apr 14 19:09:15 user devstack@n-api.service[61674]: method: > Apr 14 19:09:15 user devstack@n-api.service[61674]: exception: Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 could not be found. Apr 14 19:09:15 user devstack@n-api.service[61674]: action_args: {'id': 'd4a54fb1-bd66-42f5-9f8c-9fb40470f468'} Apr 14 19:09:15 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 could not be found. Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 could not be found. Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 could not be found. Apr 14 19:09:15 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:09:15 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-6728f748-90ee-40cb-b0b8-6160756cde89 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Returning 404 to user: Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:09:15 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-6728f748-90ee-40cb-b0b8-6160756cde89 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468" status: 404 len: 111 microversion: 2.1 time: 0.138330 Apr 14 19:09:15 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 351/1044] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:09:15 2023] GET /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:09:15 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-2ca23446-1216-4814-8499-636bd525b507 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:09:15 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-2ca23446-1216-4814-8499-636bd525b507 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:09:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2ca23446-1216-4814-8499-636bd525b507 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2ca23446-1216-4814-8499-636bd525b507 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2ca23446-1216-4814-8499-636bd525b507 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2ca23446-1216-4814-8499-636bd525b507 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2ca23446-1216-4814-8499-636bd525b507 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2ca23446-1216-4814-8499-636bd525b507 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:15 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-2ca23446-1216-4814-8499-636bd525b507 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] HTTP exception thrown: Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 could not be found. Apr 14 19:09:15 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-2ca23446-1216-4814-8499-636bd525b507 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Request method failure captured: Apr 14 19:09:15 user devstack@n-api.service[61675]: request: DELETE /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468 HTTP/1.1 Apr 14 19:09:15 user devstack@n-api.service[61675]: Accept: application/json Apr 14 19:09:15 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 19:09:15 user devstack@n-api.service[61675]: Connection: close Apr 14 19:09:15 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 19:09:15 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 19:09:15 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 19:09:15 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 19:09:15 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 19:09:15 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOZ9tFQYzH-U4RXmRE_GBoSoFEKSavu1XrGPWcT-lLfWHZbvzWQQWjWk59HjQ1Ma0lTR2YMhCPS0AAOW5m4ixuYIAB7rIJDTkb3oWnMUTJ4Uv-ETUGbIaxeHZCMtexw9UCn-fsw1BljHz-gqw0vXC9BSP_BSd7HFV75kPj8WIUaZxMdo Apr 14 19:09:15 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 19:09:15 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 19:09:15 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 19:09:15 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 19:09:15 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 19:09:15 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 19:09:15 user devstack@n-api.service[61675]: X-Project-Id: f028a79640b848228dc6e654a0eef49b Apr 14 19:09:15 user devstack@n-api.service[61675]: X-Project-Name: tempest-ServerActionsTestJSON-2112054326 Apr 14 19:09:15 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 19:09:15 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 19:09:15 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:09:15 user devstack@n-api.service[61675]: X-Tenant: tempest-ServerActionsTestJSON-2112054326 Apr 14 19:09:15 user devstack@n-api.service[61675]: X-Tenant-Id: f028a79640b848228dc6e654a0eef49b Apr 14 19:09:15 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-ServerActionsTestJSON-2112054326 Apr 14 19:09:15 user devstack@n-api.service[61675]: X-User: tempest-ServerActionsTestJSON-2112054326-project-member Apr 14 19:09:15 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 19:09:15 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 19:09:15 user devstack@n-api.service[61675]: X-User-Id: 55fa4abe2fdd48cb91f39bf8156a7793 Apr 14 19:09:15 user devstack@n-api.service[61675]: X-User-Name: tempest-ServerActionsTestJSON-2112054326-project-member Apr 14 19:09:15 user devstack@n-api.service[61675]: method: > Apr 14 19:09:15 user devstack@n-api.service[61675]: exception: Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 could not be found. Apr 14 19:09:15 user devstack@n-api.service[61675]: action_args: {'id': 'd4a54fb1-bd66-42f5-9f8c-9fb40470f468'} Apr 14 19:09:15 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 could not be found. Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 could not be found. Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 could not be found. Apr 14 19:09:15 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:09:15 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-2ca23446-1216-4814-8499-636bd525b507 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Returning 404 to user: Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:09:15 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-2ca23446-1216-4814-8499-636bd525b507 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468" status: 404 len: 111 microversion: 2.1 time: 0.051569 Apr 14 19:09:15 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 348/1045] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:09:15 2023] DELETE /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:09:15 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-111788cb-2b2f-41e0-86c1-f342e66f864a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:09:15 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-111788cb-2b2f-41e0-86c1-f342e66f864a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:09:15 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-111788cb-2b2f-41e0-86c1-f342e66f864a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:15 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-111788cb-2b2f-41e0-86c1-f342e66f864a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:15 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-111788cb-2b2f-41e0-86c1-f342e66f864a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:15 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-111788cb-2b2f-41e0-86c1-f342e66f864a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:15 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-111788cb-2b2f-41e0-86c1-f342e66f864a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:15 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-111788cb-2b2f-41e0-86c1-f342e66f864a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:15 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-111788cb-2b2f-41e0-86c1-f342e66f864a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] HTTP exception thrown: Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 could not be found. Apr 14 19:09:15 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-111788cb-2b2f-41e0-86c1-f342e66f864a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Request method failure captured: Apr 14 19:09:15 user devstack@n-api.service[61673]: request: GET /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468 HTTP/1.1 Apr 14 19:09:15 user devstack@n-api.service[61673]: Accept: application/json Apr 14 19:09:15 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 19:09:15 user devstack@n-api.service[61673]: Connection: close Apr 14 19:09:15 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 19:09:15 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 19:09:15 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 19:09:15 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 19:09:15 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 19:09:15 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOZ9tFQYzH-U4RXmRE_GBoSoFEKSavu1XrGPWcT-lLfWHZbvzWQQWjWk59HjQ1Ma0lTR2YMhCPS0AAOW5m4ixuYIAB7rIJDTkb3oWnMUTJ4Uv-ETUGbIaxeHZCMtexw9UCn-fsw1BljHz-gqw0vXC9BSP_BSd7HFV75kPj8WIUaZxMdo Apr 14 19:09:15 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 19:09:15 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 19:09:15 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 19:09:15 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 19:09:15 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 19:09:15 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 19:09:15 user devstack@n-api.service[61673]: X-Project-Id: f028a79640b848228dc6e654a0eef49b Apr 14 19:09:15 user devstack@n-api.service[61673]: X-Project-Name: tempest-ServerActionsTestJSON-2112054326 Apr 14 19:09:15 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 19:09:15 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 19:09:15 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:09:15 user devstack@n-api.service[61673]: X-Tenant: tempest-ServerActionsTestJSON-2112054326 Apr 14 19:09:15 user devstack@n-api.service[61673]: X-Tenant-Id: f028a79640b848228dc6e654a0eef49b Apr 14 19:09:15 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-ServerActionsTestJSON-2112054326 Apr 14 19:09:15 user devstack@n-api.service[61673]: X-User: tempest-ServerActionsTestJSON-2112054326-project-member Apr 14 19:09:15 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 19:09:15 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 19:09:15 user devstack@n-api.service[61673]: X-User-Id: 55fa4abe2fdd48cb91f39bf8156a7793 Apr 14 19:09:15 user devstack@n-api.service[61673]: X-User-Name: tempest-ServerActionsTestJSON-2112054326-project-member Apr 14 19:09:15 user devstack@n-api.service[61673]: method: > Apr 14 19:09:15 user devstack@n-api.service[61673]: exception: Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 could not be found. Apr 14 19:09:15 user devstack@n-api.service[61673]: action_args: {'id': 'd4a54fb1-bd66-42f5-9f8c-9fb40470f468'} Apr 14 19:09:15 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 could not be found. Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 could not be found. Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 could not be found. Apr 14 19:09:15 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:09:15 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-111788cb-2b2f-41e0-86c1-f342e66f864a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Returning 404 to user: Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:09:15 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-111788cb-2b2f-41e0-86c1-f342e66f864a tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468" status: 404 len: 111 microversion: 2.1 time: 0.031271 Apr 14 19:09:15 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 347/1046] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:09:15 2023] GET /compute/v2.1/servers/d4a54fb1-bd66-42f5-9f8c-9fb40470f468 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:09:15 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:09:15 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:09:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:15 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:15 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Going to try to terminate instance {{(pid=61674) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 19:09:15 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/46d51513-1995-43c5-976a-40789ae575f1" status: 204 len: 0 microversion: 2.1 time: 0.173030 Apr 14 19:09:15 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 352/1047] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:09:15 2023] DELETE /compute/v2.1/servers/46d51513-1995-43c5-976a-40789ae575f1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 19:09:15 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-88b2fb55-a647-49d8-97c6-41dac6cbdb38 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:09:15 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-88b2fb55-a647-49d8-97c6-41dac6cbdb38 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:09:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-88b2fb55-a647-49d8-97c6-41dac6cbdb38 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-88b2fb55-a647-49d8-97c6-41dac6cbdb38 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-88b2fb55-a647-49d8-97c6-41dac6cbdb38 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-88b2fb55-a647-49d8-97c6-41dac6cbdb38 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-88b2fb55-a647-49d8-97c6-41dac6cbdb38 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:16 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-88b2fb55-a647-49d8-97c6-41dac6cbdb38 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:16 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-88b2fb55-a647-49d8-97c6-41dac6cbdb38 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:09:16 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-88b2fb55-a647-49d8-97c6-41dac6cbdb38 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46d51513-1995-43c5-976a-40789ae575f1" status: 200 len: 1545 microversion: 2.1 time: 0.253483 Apr 14 19:09:16 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 349/1048] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:09:15 2023] GET /compute/v2.1/servers/46d51513-1995-43c5-976a-40789ae575f1 => generated 1545 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:09:16 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-0a6f1070-f574-4607-8285-fa2ce2d34dcc req-75aae369-570b-4a0f-8d4a-1b246b2f26fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d51513-1995-43c5-976a-40789ae575f1", "name": "network-vif-unplugged", "status": "completed", "tag": "48f196d4-dd0c-4499-8b7b-b0c4199cc059"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:09:16 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-0a6f1070-f574-4607-8285-fa2ce2d34dcc req-75aae369-570b-4a0f-8d4a-1b246b2f26fc service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:16 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-0a6f1070-f574-4607-8285-fa2ce2d34dcc req-75aae369-570b-4a0f-8d4a-1b246b2f26fc service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:16 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-0a6f1070-f574-4607-8285-fa2ce2d34dcc req-75aae369-570b-4a0f-8d4a-1b246b2f26fc service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:16 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-0a6f1070-f574-4607-8285-fa2ce2d34dcc req-75aae369-570b-4a0f-8d4a-1b246b2f26fc service nova] Creating event network-vif-unplugged:48f196d4-dd0c-4499-8b7b-b0c4199cc059 for instance 46d51513-1995-43c5-976a-40789ae575f1 on user Apr 14 19:09:16 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-0a6f1070-f574-4607-8285-fa2ce2d34dcc req-75aae369-570b-4a0f-8d4a-1b246b2f26fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041611 Apr 14 19:09:16 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 348/1049] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:09:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:09:17 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-24cba4c1-7a50-4ac6-9b8c-e28363ac231f req-55680696-85d9-44fb-80dd-d17f22a482f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d51513-1995-43c5-976a-40789ae575f1", "name": "network-vif-deleted", "tag": "48f196d4-dd0c-4499-8b7b-b0c4199cc059"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:09:17 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-24cba4c1-7a50-4ac6-9b8c-e28363ac231f req-55680696-85d9-44fb-80dd-d17f22a482f0 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:17 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-24cba4c1-7a50-4ac6-9b8c-e28363ac231f req-55680696-85d9-44fb-80dd-d17f22a482f0 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:17 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-24cba4c1-7a50-4ac6-9b8c-e28363ac231f req-55680696-85d9-44fb-80dd-d17f22a482f0 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:17 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-24cba4c1-7a50-4ac6-9b8c-e28363ac231f req-55680696-85d9-44fb-80dd-d17f22a482f0 service nova] Creating event network-vif-deleted:48f196d4-dd0c-4499-8b7b-b0c4199cc059 for instance 46d51513-1995-43c5-976a-40789ae575f1 on user Apr 14 19:09:17 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-24cba4c1-7a50-4ac6-9b8c-e28363ac231f req-55680696-85d9-44fb-80dd-d17f22a482f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035560 Apr 14 19:09:17 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 353/1050] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:09:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:09:18 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-f742181f-59ed-44df-a45c-ce573f952a9c req-8795bf3a-f544-4264-b38f-16fd84276591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d51513-1995-43c5-976a-40789ae575f1", "name": "network-vif-plugged", "status": "completed", "tag": "48f196d4-dd0c-4499-8b7b-b0c4199cc059"}, {"name": "network-changed", "server_uuid": "be4d9a7a-db6a-4590-9d91-7283024477f8", "tag": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:09:18 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-f742181f-59ed-44df-a45c-ce573f952a9c req-8795bf3a-f544-4264-b38f-16fd84276591 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:18 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-f742181f-59ed-44df-a45c-ce573f952a9c req-8795bf3a-f544-4264-b38f-16fd84276591 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:18 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-f742181f-59ed-44df-a45c-ce573f952a9c req-8795bf3a-f544-4264-b38f-16fd84276591 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:18 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-f742181f-59ed-44df-a45c-ce573f952a9c req-8795bf3a-f544-4264-b38f-16fd84276591 service nova] Creating event network-vif-plugged:48f196d4-dd0c-4499-8b7b-b0c4199cc059 for instance 46d51513-1995-43c5-976a-40789ae575f1 on user Apr 14 19:09:18 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-f742181f-59ed-44df-a45c-ce573f952a9c req-8795bf3a-f544-4264-b38f-16fd84276591 service nova] Creating event network-changed:1ec8a1a9-4379-425f-90c0-7781c1bf8e7d for instance be4d9a7a-db6a-4590-9d91-7283024477f8 on user Apr 14 19:09:18 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-f742181f-59ed-44df-a45c-ce573f952a9c req-8795bf3a-f544-4264-b38f-16fd84276591 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.033717 Apr 14 19:09:18 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 350/1051] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:09:18 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:09:23 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-844a984f-b898-44b1-a053-d0a5133cd727 req-c521276e-5fa0-421d-958a-262329fc3d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be4d9a7a-db6a-4590-9d91-7283024477f8", "name": "network-vif-plugged", "status": "completed", "tag": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:09:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-844a984f-b898-44b1-a053-d0a5133cd727 req-c521276e-5fa0-421d-958a-262329fc3d2d service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-844a984f-b898-44b1-a053-d0a5133cd727 req-c521276e-5fa0-421d-958a-262329fc3d2d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:23 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-844a984f-b898-44b1-a053-d0a5133cd727 req-c521276e-5fa0-421d-958a-262329fc3d2d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:23 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-844a984f-b898-44b1-a053-d0a5133cd727 req-c521276e-5fa0-421d-958a-262329fc3d2d service nova] Creating event network-vif-plugged:1ec8a1a9-4379-425f-90c0-7781c1bf8e7d for instance be4d9a7a-db6a-4590-9d91-7283024477f8 on user Apr 14 19:09:23 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-844a984f-b898-44b1-a053-d0a5133cd727 req-c521276e-5fa0-421d-958a-262329fc3d2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033579 Apr 14 19:09:23 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 349/1052] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:09:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:09:25 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-97585cb1-8eff-4b0d-8261-8ba896be4e30 req-9fcc97bf-cfaf-48fc-8cee-371740359b61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be4d9a7a-db6a-4590-9d91-7283024477f8", "name": "network-vif-plugged", "status": "completed", "tag": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:09:26 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-97585cb1-8eff-4b0d-8261-8ba896be4e30 req-9fcc97bf-cfaf-48fc-8cee-371740359b61 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:26 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-97585cb1-8eff-4b0d-8261-8ba896be4e30 req-9fcc97bf-cfaf-48fc-8cee-371740359b61 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:26 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-97585cb1-8eff-4b0d-8261-8ba896be4e30 req-9fcc97bf-cfaf-48fc-8cee-371740359b61 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:26 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-97585cb1-8eff-4b0d-8261-8ba896be4e30 req-9fcc97bf-cfaf-48fc-8cee-371740359b61 service nova] Creating event network-vif-plugged:1ec8a1a9-4379-425f-90c0-7781c1bf8e7d for instance be4d9a7a-db6a-4590-9d91-7283024477f8 on user Apr 14 19:09:26 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-97585cb1-8eff-4b0d-8261-8ba896be4e30 req-9fcc97bf-cfaf-48fc-8cee-371740359b61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030895 Apr 14 19:09:26 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 354/1053] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:09:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:09:32 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:09:32 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=6 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:09:32 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=6 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:09:32 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:09:32 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:09:32 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:09:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:32 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:32 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Going to try to terminate instance {{(pid=61675) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 19:09:32 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dab65dfd-f2a1-4631-82a2-70a18f0f33f7" status: 204 len: 0 microversion: 2.1 time: 0.120613 Apr 14 19:09:32 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 351/1054] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:09:32 2023] DELETE /compute/v2.1/servers/dab65dfd-f2a1-4631-82a2-70a18f0f33f7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 19:09:32 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-5a09029b-1339-4610-ad87-ffb5d7bf8f6b tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:09:32 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-5a09029b-1339-4610-ad87-ffb5d7bf8f6b tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:09:32 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:09:32 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=23 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:09:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5a09029b-1339-4610-ad87-ffb5d7bf8f6b tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5a09029b-1339-4610-ad87-ffb5d7bf8f6b tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5a09029b-1339-4610-ad87-ffb5d7bf8f6b tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5a09029b-1339-4610-ad87-ffb5d7bf8f6b tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5a09029b-1339-4610-ad87-ffb5d7bf8f6b tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:32 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-5a09029b-1339-4610-ad87-ffb5d7bf8f6b tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:32 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=33,nova_cell1:INSERT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:09:32 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-3fe78c53-337f-429c-87ab-01d3cf65fa3b req-06463ff5-9732-42de-a619-9b59b6b0de35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab65dfd-f2a1-4631-82a2-70a18f0f33f7", "name": "network-vif-unplugged", "status": "completed", "tag": "7c974323-9ad0-4786-b46b-27b6d54a612b"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:09:32 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:09:32 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-3fe78c53-337f-429c-87ab-01d3cf65fa3b req-06463ff5-9732-42de-a619-9b59b6b0de35 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:32 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-3fe78c53-337f-429c-87ab-01d3cf65fa3b req-06463ff5-9732-42de-a619-9b59b6b0de35 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:32 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-3fe78c53-337f-429c-87ab-01d3cf65fa3b req-06463ff5-9732-42de-a619-9b59b6b0de35 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:32 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:09:32 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-3fe78c53-337f-429c-87ab-01d3cf65fa3b req-06463ff5-9732-42de-a619-9b59b6b0de35 service nova] Creating event network-vif-unplugged:7c974323-9ad0-4786-b46b-27b6d54a612b for instance dab65dfd-f2a1-4631-82a2-70a18f0f33f7 on user Apr 14 19:09:32 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-3fe78c53-337f-429c-87ab-01d3cf65fa3b req-06463ff5-9732-42de-a619-9b59b6b0de35 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035498 Apr 14 19:09:32 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 355/1055] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:09:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 19:09:32 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-5a09029b-1339-4610-ad87-ffb5d7bf8f6b tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1b6efb65b541ef992b66d9d06bd03f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f71b0490e5a4d3b9300dc510b936a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:09:32 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-5a09029b-1339-4610-ad87-ffb5d7bf8f6b tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dab65dfd-f2a1-4631-82a2-70a18f0f33f7" status: 200 len: 1491 microversion: 2.1 time: 0.427185 Apr 14 19:09:32 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 350/1056] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:09:32 2023] GET /compute/v2.1/servers/dab65dfd-f2a1-4631-82a2-70a18f0f33f7 => generated 1491 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:09:34 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-047ca11f-715c-40b8-837d-74b86b4da3ce req-4f182c36-cfc0-46b5-9cd3-aaa4f1ef91ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab65dfd-f2a1-4631-82a2-70a18f0f33f7", "name": "network-vif-plugged", "status": "completed", "tag": "7c974323-9ad0-4786-b46b-27b6d54a612b"}, {"server_uuid": "dab65dfd-f2a1-4631-82a2-70a18f0f33f7", "name": "network-vif-deleted", "tag": "7c974323-9ad0-4786-b46b-27b6d54a612b"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:09:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-047ca11f-715c-40b8-837d-74b86b4da3ce req-4f182c36-cfc0-46b5-9cd3-aaa4f1ef91ba service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-047ca11f-715c-40b8-837d-74b86b4da3ce req-4f182c36-cfc0-46b5-9cd3-aaa4f1ef91ba service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:34 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-047ca11f-715c-40b8-837d-74b86b4da3ce req-4f182c36-cfc0-46b5-9cd3-aaa4f1ef91ba service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:34 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-047ca11f-715c-40b8-837d-74b86b4da3ce req-4f182c36-cfc0-46b5-9cd3-aaa4f1ef91ba service nova] Creating event network-vif-plugged:7c974323-9ad0-4786-b46b-27b6d54a612b for instance dab65dfd-f2a1-4631-82a2-70a18f0f33f7 on user Apr 14 19:09:34 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-047ca11f-715c-40b8-837d-74b86b4da3ce req-4f182c36-cfc0-46b5-9cd3-aaa4f1ef91ba service nova] Creating event network-vif-deleted:7c974323-9ad0-4786-b46b-27b6d54a612b for instance dab65dfd-f2a1-4631-82a2-70a18f0f33f7 on user Apr 14 19:09:34 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-047ca11f-715c-40b8-837d-74b86b4da3ce req-4f182c36-cfc0-46b5-9cd3-aaa4f1ef91ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043096 Apr 14 19:09:34 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 352/1057] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:09:34 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:09:47 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:09:47 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-7bc6480a-61f8-4cfb-8243-9bdf6c4fe488 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:09:47 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-7bc6480a-61f8-4cfb-8243-9bdf6c4fe488 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:09:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7bc6480a-61f8-4cfb-8243-9bdf6c4fe488 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7bc6480a-61f8-4cfb-8243-9bdf6c4fe488 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7bc6480a-61f8-4cfb-8243-9bdf6c4fe488 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7bc6480a-61f8-4cfb-8243-9bdf6c4fe488 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7bc6480a-61f8-4cfb-8243-9bdf6c4fe488 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7bc6480a-61f8-4cfb-8243-9bdf6c4fe488 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:47 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-7bc6480a-61f8-4cfb-8243-9bdf6c4fe488 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda4004af79e4162acea243b475c4fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ba27cb61ba410a875c07ad41d363ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:09:47 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-7bc6480a-61f8-4cfb-8243-9bdf6c4fe488 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fd6574c-2f67-46a9-838d-81f125c01b13" status: 200 len: 1454 microversion: 2.1 time: 0.309520 Apr 14 19:09:47 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 356/1058] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:09:47 2023] GET /compute/v2.1/servers/0fd6574c-2f67-46a9-838d-81f125c01b13 => generated 1454 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:09:56 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-269573ca-0047-4401-a479-b85bc33a0f0d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:09:56 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-269573ca-0047-4401-a479-b85bc33a0f0d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:09:56 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:09:56 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=5 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:09:56 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-269573ca-0047-4401-a479-b85bc33a0f0d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:56 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-269573ca-0047-4401-a479-b85bc33a0f0d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:56 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-269573ca-0047-4401-a479-b85bc33a0f0d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:56 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-269573ca-0047-4401-a479-b85bc33a0f0d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:56 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-269573ca-0047-4401-a479-b85bc33a0f0d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:56 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-269573ca-0047-4401-a479-b85bc33a0f0d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:56 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-269573ca-0047-4401-a479-b85bc33a0f0d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054390 Apr 14 19:09:56 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 351/1059] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 19:09:56 2023] GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:09:56 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:09:56 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:09:56 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:09:56 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:09:56 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:56 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:56 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:56 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:56 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:56 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:56 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Going to try to terminate instance {{(pid=61675) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 19:09:56 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a" status: 204 len: 0 microversion: 2.20 time: 0.135519 Apr 14 19:09:56 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 353/1060] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 19:09:56 2023] DELETE /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 19:09:56 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-d4a593d8-ce46-41f4-8a48-0b05642f6901 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:09:56 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-d4a593d8-ce46-41f4-8a48-0b05642f6901 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:09:56 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d4a593d8-ce46-41f4-8a48-0b05642f6901 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:56 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d4a593d8-ce46-41f4-8a48-0b05642f6901 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:56 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d4a593d8-ce46-41f4-8a48-0b05642f6901 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:56 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d4a593d8-ce46-41f4-8a48-0b05642f6901 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:56 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d4a593d8-ce46-41f4-8a48-0b05642f6901 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:56 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d4a593d8-ce46-41f4-8a48-0b05642f6901 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:56 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-d4a593d8-ce46-41f4-8a48-0b05642f6901 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:09:56 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-d4a593d8-ce46-41f4-8a48-0b05642f6901 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:09:56 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-d4a593d8-ce46-41f4-8a48-0b05642f6901 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:09:56 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-d4a593d8-ce46-41f4-8a48-0b05642f6901 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a" status: 200 len: 1712 microversion: 2.20 time: 0.271980 Apr 14 19:09:56 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-9dbce4fe-a845-4f08-af7a-2781e22c9f50 req-a1a6ff1b-cfa2-4863-9d03-ecca9008e94a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179270ef-7866-4ee7-af13-ec3ea5e7525a", "name": "network-vif-unplugged", "status": "completed", "tag": "fef01e15-9070-4b0b-ba18-0b9540774cb9"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:09:56 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 357/1061] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:09:56 2023] GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a => generated 1712 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 19:09:56 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9dbce4fe-a845-4f08-af7a-2781e22c9f50 req-a1a6ff1b-cfa2-4863-9d03-ecca9008e94a service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:56 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9dbce4fe-a845-4f08-af7a-2781e22c9f50 req-a1a6ff1b-cfa2-4863-9d03-ecca9008e94a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:56 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9dbce4fe-a845-4f08-af7a-2781e22c9f50 req-a1a6ff1b-cfa2-4863-9d03-ecca9008e94a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:56 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-9dbce4fe-a845-4f08-af7a-2781e22c9f50 req-a1a6ff1b-cfa2-4863-9d03-ecca9008e94a service nova] Creating event network-vif-unplugged:fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance 179270ef-7866-4ee7-af13-ec3ea5e7525a on user Apr 14 19:09:56 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-9dbce4fe-a845-4f08-af7a-2781e22c9f50 req-a1a6ff1b-cfa2-4863-9d03-ecca9008e94a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032014 Apr 14 19:09:56 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 352/1062] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:09:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:09:58 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179270ef-7866-4ee7-af13-ec3ea5e7525a", "name": "network-vif-plugged", "status": "completed", "tag": "fef01e15-9070-4b0b-ba18-0b9540774cb9"}, {"server_uuid": "179270ef-7866-4ee7-af13-ec3ea5e7525a", "name": "network-vif-plugged", "status": "completed", "tag": "fef01e15-9070-4b0b-ba18-0b9540774cb9"}, {"server_uuid": "179270ef-7866-4ee7-af13-ec3ea5e7525a", "name": "network-vif-plugged", "status": "completed", "tag": "fef01e15-9070-4b0b-ba18-0b9540774cb9"}, {"server_uuid": "179270ef-7866-4ee7-af13-ec3ea5e7525a", "name": "network-vif-unplugged", "status": "completed", "tag": "fef01e15-9070-4b0b-ba18-0b9540774cb9"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:09:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:09:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:09:58 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:09:58 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] Creating event network-vif-plugged:fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance 179270ef-7866-4ee7-af13-ec3ea5e7525a on user Apr 14 19:09:58 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] Creating event network-vif-plugged:fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance 179270ef-7866-4ee7-af13-ec3ea5e7525a on user Apr 14 19:09:58 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] Creating event network-vif-plugged:fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance 179270ef-7866-4ee7-af13-ec3ea5e7525a on user Apr 14 19:09:58 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] Creating event network-vif-unplugged:fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance 179270ef-7866-4ee7-af13-ec3ea5e7525a on user Apr 14 19:09:58 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.031942 Apr 14 19:09:58 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 354/1063] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:09:58 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:10:00 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-6dc641fa-98df-423e-a151-943284e923c0 req-670c3ac6-4124-46ec-b704-35c74a55403e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179270ef-7866-4ee7-af13-ec3ea5e7525a", "name": "network-vif-plugged", "status": "completed", "tag": "fef01e15-9070-4b0b-ba18-0b9540774cb9"}, {"server_uuid": "179270ef-7866-4ee7-af13-ec3ea5e7525a", "name": "network-vif-deleted", "tag": "fef01e15-9070-4b0b-ba18-0b9540774cb9"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:10:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6dc641fa-98df-423e-a151-943284e923c0 req-670c3ac6-4124-46ec-b704-35c74a55403e service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6dc641fa-98df-423e-a151-943284e923c0 req-670c3ac6-4124-46ec-b704-35c74a55403e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:00 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6dc641fa-98df-423e-a151-943284e923c0 req-670c3ac6-4124-46ec-b704-35c74a55403e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:00 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-6dc641fa-98df-423e-a151-943284e923c0 req-670c3ac6-4124-46ec-b704-35c74a55403e service nova] Creating event network-vif-plugged:fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance 179270ef-7866-4ee7-af13-ec3ea5e7525a on user Apr 14 19:10:00 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-6dc641fa-98df-423e-a151-943284e923c0 req-670c3ac6-4124-46ec-b704-35c74a55403e service nova] Creating event network-vif-deleted:fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance 179270ef-7866-4ee7-af13-ec3ea5e7525a on user Apr 14 19:10:00 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-6dc641fa-98df-423e-a151-943284e923c0 req-670c3ac6-4124-46ec-b704-35c74a55403e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036867 Apr 14 19:10:00 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 358/1064] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:10:00 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:10:03 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-56441aaa-f305-4f8a-bcd9-f4af9c085f71 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:10:03 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-56441aaa-f305-4f8a-bcd9-f4af9c085f71 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:10:03 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-56441aaa-f305-4f8a-bcd9-f4af9c085f71 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:03 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-56441aaa-f305-4f8a-bcd9-f4af9c085f71 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:03 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-56441aaa-f305-4f8a-bcd9-f4af9c085f71 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:03 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-56441aaa-f305-4f8a-bcd9-f4af9c085f71 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:03 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-56441aaa-f305-4f8a-bcd9-f4af9c085f71 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:03 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-56441aaa-f305-4f8a-bcd9-f4af9c085f71 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:03 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-56441aaa-f305-4f8a-bcd9-f4af9c085f71 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045690 Apr 14 19:10:03 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 353/1065] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 19:10:03 2023] GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 19:10:04 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-871a6d2b-f9c5-450d-90a1-d12fefb0f473 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:10:04 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-871a6d2b-f9c5-450d-90a1-d12fefb0f473 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:10:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-871a6d2b-f9c5-450d-90a1-d12fefb0f473 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-871a6d2b-f9c5-450d-90a1-d12fefb0f473 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-871a6d2b-f9c5-450d-90a1-d12fefb0f473 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-871a6d2b-f9c5-450d-90a1-d12fefb0f473 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-871a6d2b-f9c5-450d-90a1-d12fefb0f473 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-871a6d2b-f9c5-450d-90a1-d12fefb0f473 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:04 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-871a6d2b-f9c5-450d-90a1-d12fefb0f473 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:10:04 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-871a6d2b-f9c5-450d-90a1-d12fefb0f473 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be4d9a7a-db6a-4590-9d91-7283024477f8" status: 200 len: 1441 microversion: 2.1 time: 0.233379 Apr 14 19:10:04 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 355/1066] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:10:04 2023] GET /compute/v2.1/servers/be4d9a7a-db6a-4590-9d91-7283024477f8 => generated 1441 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:10:06 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-46532047-4b3a-474f-9e51-577c4a42cae9 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:10:06 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-46532047-4b3a-474f-9e51-577c4a42cae9 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:10:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-46532047-4b3a-474f-9e51-577c4a42cae9 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-46532047-4b3a-474f-9e51-577c4a42cae9 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-46532047-4b3a-474f-9e51-577c4a42cae9 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-46532047-4b3a-474f-9e51-577c4a42cae9 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-46532047-4b3a-474f-9e51-577c4a42cae9 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-46532047-4b3a-474f-9e51-577c4a42cae9 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:06 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-46532047-4b3a-474f-9e51-577c4a42cae9 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] HTTP exception thrown: Instance 46d51513-1995-43c5-976a-40789ae575f1 could not be found. Apr 14 19:10:06 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-46532047-4b3a-474f-9e51-577c4a42cae9 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Request method failure captured: Apr 14 19:10:06 user devstack@n-api.service[61674]: request: GET /compute/v2.1/servers/46d51513-1995-43c5-976a-40789ae575f1 HTTP/1.1 Apr 14 19:10:06 user devstack@n-api.service[61674]: Accept: application/json Apr 14 19:10:06 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 19:10:06 user devstack@n-api.service[61674]: Connection: close Apr 14 19:10:06 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 19:10:06 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 19:10:06 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 19:10:06 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 19:10:06 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 19:10:06 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOZ9tFQYzH-U4RXmRE_GBoSoFEKSavu1XrGPWcT-lLfWHZbvzWQQWjWk59HjQ1Ma0lTR2YMhCPS0AAOW5m4ixuYIAB7rIJDTkb3oWnMUTJ4Uv-ETUGbIaxeHZCMtexw9UCn-fsw1BljHz-gqw0vXC9BSP_BSd7HFV75kPj8WIUaZxMdo Apr 14 19:10:06 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 19:10:06 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 19:10:06 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 19:10:06 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 19:10:06 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 19:10:06 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 19:10:06 user devstack@n-api.service[61674]: X-Project-Id: f028a79640b848228dc6e654a0eef49b Apr 14 19:10:06 user devstack@n-api.service[61674]: X-Project-Name: tempest-ServerActionsTestJSON-2112054326 Apr 14 19:10:06 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 19:10:06 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 19:10:06 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:10:06 user devstack@n-api.service[61674]: X-Tenant: tempest-ServerActionsTestJSON-2112054326 Apr 14 19:10:06 user devstack@n-api.service[61674]: X-Tenant-Id: f028a79640b848228dc6e654a0eef49b Apr 14 19:10:06 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-ServerActionsTestJSON-2112054326 Apr 14 19:10:06 user devstack@n-api.service[61674]: X-User: tempest-ServerActionsTestJSON-2112054326-project-member Apr 14 19:10:06 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 19:10:06 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 19:10:06 user devstack@n-api.service[61674]: X-User-Id: 55fa4abe2fdd48cb91f39bf8156a7793 Apr 14 19:10:06 user devstack@n-api.service[61674]: X-User-Name: tempest-ServerActionsTestJSON-2112054326-project-member Apr 14 19:10:06 user devstack@n-api.service[61674]: method: > Apr 14 19:10:06 user devstack@n-api.service[61674]: exception: Instance 46d51513-1995-43c5-976a-40789ae575f1 could not be found. Apr 14 19:10:06 user devstack@n-api.service[61674]: action_args: {'id': '46d51513-1995-43c5-976a-40789ae575f1'} Apr 14 19:10:06 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46d51513-1995-43c5-976a-40789ae575f1 could not be found. Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46d51513-1995-43c5-976a-40789ae575f1 could not be found. Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46d51513-1995-43c5-976a-40789ae575f1 could not be found. Apr 14 19:10:06 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:10:06 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-46532047-4b3a-474f-9e51-577c4a42cae9 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Returning 404 to user: Instance 46d51513-1995-43c5-976a-40789ae575f1 could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:10:06 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-46532047-4b3a-474f-9e51-577c4a42cae9 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46d51513-1995-43c5-976a-40789ae575f1" status: 404 len: 111 microversion: 2.1 time: 0.033617 Apr 14 19:10:06 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 359/1067] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:10:06 2023] GET /compute/v2.1/servers/46d51513-1995-43c5-976a-40789ae575f1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:10:13 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-ddd1c007-b6dc-4b84-b304-608a07e07c9f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:10:13 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-ddd1c007-b6dc-4b84-b304-608a07e07c9f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:10:14 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=6 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:10:14 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=14 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:10:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ddd1c007-b6dc-4b84-b304-608a07e07c9f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ddd1c007-b6dc-4b84-b304-608a07e07c9f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ddd1c007-b6dc-4b84-b304-608a07e07c9f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ddd1c007-b6dc-4b84-b304-608a07e07c9f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ddd1c007-b6dc-4b84-b304-608a07e07c9f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-ddd1c007-b6dc-4b84-b304-608a07e07c9f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:14 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-ddd1c007-b6dc-4b84-b304-608a07e07c9f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] HTTP exception thrown: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. Apr 14 19:10:14 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-ddd1c007-b6dc-4b84-b304-608a07e07c9f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Request method failure captured: Apr 14 19:10:14 user devstack@n-api.service[61673]: request: DELETE /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be HTTP/1.1 Apr 14 19:10:14 user devstack@n-api.service[61673]: Accept: application/json Apr 14 19:10:14 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 19:10:14 user devstack@n-api.service[61673]: Connection: close Apr 14 19:10:14 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 19:10:14 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 19:10:14 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 19:10:14 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 19:10:14 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 19:10:14 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOZ9tFQYzH-U4RXmRE_GBoSoFEKSavu1XrGPWcT-lLfWHZbvzWQQWjWk59HjQ1Ma0lTR2YMhCPS0AAOW5m4ixuYIAB7rIJDTkb3oWnMUTJ4Uv-ETUGbIaxeHZCMtexw9UCn-fsw1BljHz-gqw0vXC9BSP_BSd7HFV75kPj8WIUaZxMdo Apr 14 19:10:14 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 19:10:14 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 19:10:14 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 19:10:14 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 19:10:14 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 19:10:14 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 19:10:14 user devstack@n-api.service[61673]: X-Project-Id: f028a79640b848228dc6e654a0eef49b Apr 14 19:10:14 user devstack@n-api.service[61673]: X-Project-Name: tempest-ServerActionsTestJSON-2112054326 Apr 14 19:10:14 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 19:10:14 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 19:10:14 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:10:14 user devstack@n-api.service[61673]: X-Tenant: tempest-ServerActionsTestJSON-2112054326 Apr 14 19:10:14 user devstack@n-api.service[61673]: X-Tenant-Id: f028a79640b848228dc6e654a0eef49b Apr 14 19:10:14 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-ServerActionsTestJSON-2112054326 Apr 14 19:10:14 user devstack@n-api.service[61673]: X-User: tempest-ServerActionsTestJSON-2112054326-project-member Apr 14 19:10:14 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 19:10:14 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 19:10:14 user devstack@n-api.service[61673]: X-User-Id: 55fa4abe2fdd48cb91f39bf8156a7793 Apr 14 19:10:14 user devstack@n-api.service[61673]: X-User-Name: tempest-ServerActionsTestJSON-2112054326-project-member Apr 14 19:10:14 user devstack@n-api.service[61673]: method: > Apr 14 19:10:14 user devstack@n-api.service[61673]: exception: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. Apr 14 19:10:14 user devstack@n-api.service[61673]: action_args: {'id': 'aa09363f-435d-4fa8-9f11-db0c3f4e08be'} Apr 14 19:10:14 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. Apr 14 19:10:14 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:10:14 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-ddd1c007-b6dc-4b84-b304-608a07e07c9f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Returning 404 to user: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:10:14 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-ddd1c007-b6dc-4b84-b304-608a07e07c9f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 404 len: 111 microversion: 2.1 time: 0.036489 Apr 14 19:10:14 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 354/1068] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:10:13 2023] DELETE /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:10:14 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-b50f11f5-d2cb-415e-8d46-d96d4ac1783f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:10:14 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-b50f11f5-d2cb-415e-8d46-d96d4ac1783f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:10:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b50f11f5-d2cb-415e-8d46-d96d4ac1783f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b50f11f5-d2cb-415e-8d46-d96d4ac1783f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b50f11f5-d2cb-415e-8d46-d96d4ac1783f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b50f11f5-d2cb-415e-8d46-d96d4ac1783f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b50f11f5-d2cb-415e-8d46-d96d4ac1783f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:14 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b50f11f5-d2cb-415e-8d46-d96d4ac1783f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:14 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-b50f11f5-d2cb-415e-8d46-d96d4ac1783f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] HTTP exception thrown: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. Apr 14 19:10:14 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-b50f11f5-d2cb-415e-8d46-d96d4ac1783f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Request method failure captured: Apr 14 19:10:14 user devstack@n-api.service[61675]: request: GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be HTTP/1.1 Apr 14 19:10:14 user devstack@n-api.service[61675]: Accept: application/json Apr 14 19:10:14 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 19:10:14 user devstack@n-api.service[61675]: Connection: close Apr 14 19:10:14 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 19:10:14 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 19:10:14 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 19:10:14 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 19:10:14 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 19:10:14 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOZ9tFQYzH-U4RXmRE_GBoSoFEKSavu1XrGPWcT-lLfWHZbvzWQQWjWk59HjQ1Ma0lTR2YMhCPS0AAOW5m4ixuYIAB7rIJDTkb3oWnMUTJ4Uv-ETUGbIaxeHZCMtexw9UCn-fsw1BljHz-gqw0vXC9BSP_BSd7HFV75kPj8WIUaZxMdo Apr 14 19:10:14 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 19:10:14 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 19:10:14 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 19:10:14 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 19:10:14 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 19:10:14 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 19:10:14 user devstack@n-api.service[61675]: X-Project-Id: f028a79640b848228dc6e654a0eef49b Apr 14 19:10:14 user devstack@n-api.service[61675]: X-Project-Name: tempest-ServerActionsTestJSON-2112054326 Apr 14 19:10:14 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 19:10:14 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 19:10:14 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f028a79640b848228dc6e654a0eef49b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:10:14 user devstack@n-api.service[61675]: X-Tenant: tempest-ServerActionsTestJSON-2112054326 Apr 14 19:10:14 user devstack@n-api.service[61675]: X-Tenant-Id: f028a79640b848228dc6e654a0eef49b Apr 14 19:10:14 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-ServerActionsTestJSON-2112054326 Apr 14 19:10:14 user devstack@n-api.service[61675]: X-User: tempest-ServerActionsTestJSON-2112054326-project-member Apr 14 19:10:14 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 19:10:14 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 19:10:14 user devstack@n-api.service[61675]: X-User-Id: 55fa4abe2fdd48cb91f39bf8156a7793 Apr 14 19:10:14 user devstack@n-api.service[61675]: X-User-Name: tempest-ServerActionsTestJSON-2112054326-project-member Apr 14 19:10:14 user devstack@n-api.service[61675]: method: > Apr 14 19:10:14 user devstack@n-api.service[61675]: exception: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. Apr 14 19:10:14 user devstack@n-api.service[61675]: action_args: {'id': 'aa09363f-435d-4fa8-9f11-db0c3f4e08be'} Apr 14 19:10:14 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. Apr 14 19:10:14 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:10:14 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-b50f11f5-d2cb-415e-8d46-d96d4ac1783f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Returning 404 to user: Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:10:14 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-b50f11f5-d2cb-415e-8d46-d96d4ac1783f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be" status: 404 len: 111 microversion: 2.1 time: 0.038275 Apr 14 19:10:14 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 356/1069] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:10:14 2023] GET /compute/v2.1/servers/aa09363f-435d-4fa8-9f11-db0c3f4e08be => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:10:14 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-4dff4e0e-4bce-4df9-a4f8-973daa60794b tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Calling method '.version_select at 0x7fdae1320e50>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:10:14 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-4dff4e0e-4bce-4df9-a4f8-973daa60794b tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1907005832" status: 202 len: 0 microversion: 2.1 time: 0.036702 Apr 14 19:10:14 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 360/1070] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 19:10:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1907005832 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 19:10:22 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-2e6cfe8c-2dfb-4fa2-ab74-2bf738b7f066 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:10:22 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-2e6cfe8c-2dfb-4fa2-ab74-2bf738b7f066 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:10:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2e6cfe8c-2dfb-4fa2-ab74-2bf738b7f066 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2e6cfe8c-2dfb-4fa2-ab74-2bf738b7f066 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2e6cfe8c-2dfb-4fa2-ab74-2bf738b7f066 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2e6cfe8c-2dfb-4fa2-ab74-2bf738b7f066 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2e6cfe8c-2dfb-4fa2-ab74-2bf738b7f066 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:22 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2e6cfe8c-2dfb-4fa2-ab74-2bf738b7f066 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:22 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-2e6cfe8c-2dfb-4fa2-ab74-2bf738b7f066 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] HTTP exception thrown: Instance dab65dfd-f2a1-4631-82a2-70a18f0f33f7 could not be found. Apr 14 19:10:22 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-2e6cfe8c-2dfb-4fa2-ab74-2bf738b7f066 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Request method failure captured: Apr 14 19:10:22 user devstack@n-api.service[61673]: request: GET /compute/v2.1/servers/dab65dfd-f2a1-4631-82a2-70a18f0f33f7 HTTP/1.1 Apr 14 19:10:22 user devstack@n-api.service[61673]: Accept: application/json Apr 14 19:10:22 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 19:10:22 user devstack@n-api.service[61673]: Connection: close Apr 14 19:10:22 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 19:10:22 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 19:10:22 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 19:10:22 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 19:10:22 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 19:10:22 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOaR5UR3LuM_eLBUBIXLC25V4LTdsC0bhx8OCAoCKUk_AqLZY47anDz7BOetVTF1qu5sHLmlM-sHLhygVqxCQtwz_uULe5k1yT5puqxj4kA6s4QjJaNwYVNtgC7qzDA8qE5i2Ed-OF4uPlyRt_Wif-hHqf7MqwPWv4b5ZaFKMHZADeDo Apr 14 19:10:22 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 19:10:22 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 19:10:22 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 19:10:22 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 19:10:22 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 19:10:22 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 19:10:22 user devstack@n-api.service[61673]: X-Project-Id: 5f71b0490e5a4d3b9300dc510b936a44 Apr 14 19:10:22 user devstack@n-api.service[61673]: X-Project-Name: tempest-VolumesActionsTest-1832164482 Apr 14 19:10:22 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 19:10:22 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 19:10:22 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5f71b0490e5a4d3b9300dc510b936a44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5f71b0490e5a4d3b9300dc510b936a44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5f71b0490e5a4d3b9300dc510b936a44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:10:22 user devstack@n-api.service[61673]: X-Tenant: tempest-VolumesActionsTest-1832164482 Apr 14 19:10:22 user devstack@n-api.service[61673]: X-Tenant-Id: 5f71b0490e5a4d3b9300dc510b936a44 Apr 14 19:10:22 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-VolumesActionsTest-1832164482 Apr 14 19:10:22 user devstack@n-api.service[61673]: X-User: tempest-VolumesActionsTest-1832164482-project-member Apr 14 19:10:22 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 19:10:22 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 19:10:22 user devstack@n-api.service[61673]: X-User-Id: 0b1b6efb65b541ef992b66d9d06bd03f Apr 14 19:10:22 user devstack@n-api.service[61673]: X-User-Name: tempest-VolumesActionsTest-1832164482-project-member Apr 14 19:10:22 user devstack@n-api.service[61673]: method: > Apr 14 19:10:22 user devstack@n-api.service[61673]: exception: Instance dab65dfd-f2a1-4631-82a2-70a18f0f33f7 could not be found. Apr 14 19:10:22 user devstack@n-api.service[61673]: action_args: {'id': 'dab65dfd-f2a1-4631-82a2-70a18f0f33f7'} Apr 14 19:10:22 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dab65dfd-f2a1-4631-82a2-70a18f0f33f7 could not be found. Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dab65dfd-f2a1-4631-82a2-70a18f0f33f7 could not be found. Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dab65dfd-f2a1-4631-82a2-70a18f0f33f7 could not be found. Apr 14 19:10:22 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:10:22 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-2e6cfe8c-2dfb-4fa2-ab74-2bf738b7f066 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Returning 404 to user: Instance dab65dfd-f2a1-4631-82a2-70a18f0f33f7 could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:10:22 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-2e6cfe8c-2dfb-4fa2-ab74-2bf738b7f066 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dab65dfd-f2a1-4631-82a2-70a18f0f33f7" status: 404 len: 111 microversion: 2.1 time: 0.046145 Apr 14 19:10:22 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 355/1071] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:10:22 2023] GET /compute/v2.1/servers/dab65dfd-f2a1-4631-82a2-70a18f0f33f7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:10:23 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2040926824", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "networks": [{"uuid": "d351be52-944c-4631-9649-ce34a967f20a"}]}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:10:23 user devstack@n-api.service[61675]: DEBUG nova.network.neutron [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] validate_networks() for [('d351be52-944c-4631-9649-ce34a967f20a', None, None, None, None, None)] {{(pid=61675) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 19:10:23 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Flavor limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 19:10:23 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Image limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 19:10:23 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Flavor pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 19:10:23 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Image pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 19:10:23 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 19:10:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:23 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:23 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Getting quotas for project 5f71b0490e5a4d3b9300dc510b936a44. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 19:10:23 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Getting quotas for user 0b1b6efb65b541ef992b66d9d06bd03f and project 5f71b0490e5a4d3b9300dc510b936a44. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 19:10:23 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Going to run 1 instances... {{(pid=61675) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 19:10:23 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 19:10:23 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.780856 Apr 14 19:10:23 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 357/1072] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 19:10:23 2023] POST /compute/v2.1/servers => generated 378 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 19:10:23 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=17 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:10:23 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-094252ec-0135-4d1f-9693-cfd43307352b tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:10:23 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-094252ec-0135-4d1f-9693-cfd43307352b tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:10:23 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:10:23 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-094252ec-0135-4d1f-9693-cfd43307352b tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1b6efb65b541ef992b66d9d06bd03f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f71b0490e5a4d3b9300dc510b936a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:10:23 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-094252ec-0135-4d1f-9693-cfd43307352b tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3fa57cc-781a-402e-91fc-e4ee5640960b" status: 200 len: 1208 microversion: 2.1 time: 0.078842 Apr 14 19:10:23 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 361/1073] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:10:23 2023] GET /compute/v2.1/servers/e3fa57cc-781a-402e-91fc-e4ee5640960b => generated 1208 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:10:25 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-4afa58a2-b4a1-4632-b74a-28095058f93e req-f0cd6f8a-8e24-432f-924a-5c12aae7fbb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9379580-fd2f-4468-9ed3-7109735195be", "tag": "f22a5e1e-5aed-419f-aa06-308984681fbc"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:10:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-4afa58a2-b4a1-4632-b74a-28095058f93e req-f0cd6f8a-8e24-432f-924a-5c12aae7fbb9 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-4afa58a2-b4a1-4632-b74a-28095058f93e req-f0cd6f8a-8e24-432f-924a-5c12aae7fbb9 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:25 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-4afa58a2-b4a1-4632-b74a-28095058f93e req-f0cd6f8a-8e24-432f-924a-5c12aae7fbb9 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:25 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-4afa58a2-b4a1-4632-b74a-28095058f93e req-f0cd6f8a-8e24-432f-924a-5c12aae7fbb9 service nova] Creating event network-changed:f22a5e1e-5aed-419f-aa06-308984681fbc for instance a9379580-fd2f-4468-9ed3-7109735195be on user Apr 14 19:10:25 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-4afa58a2-b4a1-4632-b74a-28095058f93e req-f0cd6f8a-8e24-432f-924a-5c12aae7fbb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032498 Apr 14 19:10:25 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 356/1074] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:10:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:10:27 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-bc4cc761-0e3b-4cc0-b80b-857cbe7a6260 req-64b60117-1eb2-4f3d-bcbd-9f26238b90af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3fa57cc-781a-402e-91fc-e4ee5640960b", "tag": "2446f800-78b9-4e6d-80cb-23be097676bd"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:10:27 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:10:27 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-bc4cc761-0e3b-4cc0-b80b-857cbe7a6260 req-64b60117-1eb2-4f3d-bcbd-9f26238b90af service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:27 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-bc4cc761-0e3b-4cc0-b80b-857cbe7a6260 req-64b60117-1eb2-4f3d-bcbd-9f26238b90af service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:27 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-bc4cc761-0e3b-4cc0-b80b-857cbe7a6260 req-64b60117-1eb2-4f3d-bcbd-9f26238b90af service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:27 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:10:27 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-bc4cc761-0e3b-4cc0-b80b-857cbe7a6260 req-64b60117-1eb2-4f3d-bcbd-9f26238b90af service nova] Creating event network-changed:2446f800-78b9-4e6d-80cb-23be097676bd for instance e3fa57cc-781a-402e-91fc-e4ee5640960b on user Apr 14 19:10:27 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-bc4cc761-0e3b-4cc0-b80b-857cbe7a6260 req-64b60117-1eb2-4f3d-bcbd-9f26238b90af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032496 Apr 14 19:10:27 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 358/1075] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:10:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:10:29 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:10:29 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:10:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:29 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Going to try to terminate instance {{(pid=61674) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 19:10:29 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be" status: 204 len: 0 microversion: 2.1 time: 0.139580 Apr 14 19:10:29 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 362/1076] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:10:29 2023] DELETE /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 19:10:29 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-1294fe7f-59eb-4dd7-9ec7-02d8e1dcb2f3 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:10:29 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-1294fe7f-59eb-4dd7-9ec7-02d8e1dcb2f3 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:10:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1294fe7f-59eb-4dd7-9ec7-02d8e1dcb2f3 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1294fe7f-59eb-4dd7-9ec7-02d8e1dcb2f3 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1294fe7f-59eb-4dd7-9ec7-02d8e1dcb2f3 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1294fe7f-59eb-4dd7-9ec7-02d8e1dcb2f3 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1294fe7f-59eb-4dd7-9ec7-02d8e1dcb2f3 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-1294fe7f-59eb-4dd7-9ec7-02d8e1dcb2f3 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:29 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-a8ff8f8b-c1a1-4507-8bcf-4b40c032ca4f req-134af061-9f36-4b5a-b41a-9bd4ed5fc8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9379580-fd2f-4468-9ed3-7109735195be", "name": "network-vif-unplugged", "status": "completed", "tag": "f22a5e1e-5aed-419f-aa06-308984681fbc"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:10:29 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-a8ff8f8b-c1a1-4507-8bcf-4b40c032ca4f req-134af061-9f36-4b5a-b41a-9bd4ed5fc8a4 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:29 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-a8ff8f8b-c1a1-4507-8bcf-4b40c032ca4f req-134af061-9f36-4b5a-b41a-9bd4ed5fc8a4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:29 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-a8ff8f8b-c1a1-4507-8bcf-4b40c032ca4f req-134af061-9f36-4b5a-b41a-9bd4ed5fc8a4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:29 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-1294fe7f-59eb-4dd7-9ec7-02d8e1dcb2f3 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10cf3683f78d4724bb734e5280e8736b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81575e6ed9bc41d2ad2ac1ad0fbd253d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:10:29 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-a8ff8f8b-c1a1-4507-8bcf-4b40c032ca4f req-134af061-9f36-4b5a-b41a-9bd4ed5fc8a4 service nova] Creating event network-vif-unplugged:f22a5e1e-5aed-419f-aa06-308984681fbc for instance a9379580-fd2f-4468-9ed3-7109735195be on user Apr 14 19:10:29 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-a8ff8f8b-c1a1-4507-8bcf-4b40c032ca4f req-134af061-9f36-4b5a-b41a-9bd4ed5fc8a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038029 Apr 14 19:10:29 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 359/1077] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:10:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:10:29 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-1294fe7f-59eb-4dd7-9ec7-02d8e1dcb2f3 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be" status: 200 len: 1574 microversion: 2.1 time: 0.651836 Apr 14 19:10:29 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 357/1078] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:10:29 2023] GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be => generated 1574 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:10:31 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-943d7bb9-4784-4ae3-97a4-8284815a610d req-6467cb86-8c8a-4788-a34b-100022e20fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9379580-fd2f-4468-9ed3-7109735195be", "name": "network-vif-deleted", "tag": "f22a5e1e-5aed-419f-aa06-308984681fbc"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:10:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-943d7bb9-4784-4ae3-97a4-8284815a610d req-6467cb86-8c8a-4788-a34b-100022e20fc5 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-943d7bb9-4784-4ae3-97a4-8284815a610d req-6467cb86-8c8a-4788-a34b-100022e20fc5 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-943d7bb9-4784-4ae3-97a4-8284815a610d req-6467cb86-8c8a-4788-a34b-100022e20fc5 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:31 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-943d7bb9-4784-4ae3-97a4-8284815a610d req-6467cb86-8c8a-4788-a34b-100022e20fc5 service nova] Creating event network-vif-deleted:f22a5e1e-5aed-419f-aa06-308984681fbc for instance a9379580-fd2f-4468-9ed3-7109735195be on user Apr 14 19:10:31 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-943d7bb9-4784-4ae3-97a4-8284815a610d req-6467cb86-8c8a-4788-a34b-100022e20fc5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037667 Apr 14 19:10:31 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 363/1079] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:10:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:10:31 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-94c36a52-767e-4b24-b1e7-78f51332de0c req-59ebe9b5-7d82-4530-bbcf-9b82203a5db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9379580-fd2f-4468-9ed3-7109735195be", "name": "network-vif-plugged", "status": "completed", "tag": "f22a5e1e-5aed-419f-aa06-308984681fbc"}, {"server_uuid": "e3fa57cc-781a-402e-91fc-e4ee5640960b", "name": "network-vif-plugged", "status": "completed", "tag": "2446f800-78b9-4e6d-80cb-23be097676bd"}, {"server_uuid": "e3fa57cc-781a-402e-91fc-e4ee5640960b", "name": "network-vif-plugged", "status": "completed", "tag": "2446f800-78b9-4e6d-80cb-23be097676bd"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:10:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-94c36a52-767e-4b24-b1e7-78f51332de0c req-59ebe9b5-7d82-4530-bbcf-9b82203a5db7 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-94c36a52-767e-4b24-b1e7-78f51332de0c req-59ebe9b5-7d82-4530-bbcf-9b82203a5db7 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:31 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-94c36a52-767e-4b24-b1e7-78f51332de0c req-59ebe9b5-7d82-4530-bbcf-9b82203a5db7 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:31 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-94c36a52-767e-4b24-b1e7-78f51332de0c req-59ebe9b5-7d82-4530-bbcf-9b82203a5db7 service nova] Creating event network-vif-plugged:f22a5e1e-5aed-419f-aa06-308984681fbc for instance a9379580-fd2f-4468-9ed3-7109735195be on user Apr 14 19:10:31 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-94c36a52-767e-4b24-b1e7-78f51332de0c req-59ebe9b5-7d82-4530-bbcf-9b82203a5db7 service nova] Creating event network-vif-plugged:2446f800-78b9-4e6d-80cb-23be097676bd for instance e3fa57cc-781a-402e-91fc-e4ee5640960b on user Apr 14 19:10:31 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-94c36a52-767e-4b24-b1e7-78f51332de0c req-59ebe9b5-7d82-4530-bbcf-9b82203a5db7 service nova] Creating event network-vif-plugged:2446f800-78b9-4e6d-80cb-23be097676bd for instance e3fa57cc-781a-402e-91fc-e4ee5640960b on user Apr 14 19:10:31 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-94c36a52-767e-4b24-b1e7-78f51332de0c req-59ebe9b5-7d82-4530-bbcf-9b82203a5db7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.041366 Apr 14 19:10:31 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 360/1080] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:10:31 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:10:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-70e775a6-2e7d-4ed4-8e02-4e896873e55a tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:10:46 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-70e775a6-2e7d-4ed4-8e02-4e896873e55a tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:10:46 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=8 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:10:46 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=12 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:10:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-70e775a6-2e7d-4ed4-8e02-4e896873e55a tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-70e775a6-2e7d-4ed4-8e02-4e896873e55a tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-70e775a6-2e7d-4ed4-8e02-4e896873e55a tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-70e775a6-2e7d-4ed4-8e02-4e896873e55a tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-70e775a6-2e7d-4ed4-8e02-4e896873e55a tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-70e775a6-2e7d-4ed4-8e02-4e896873e55a tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:46 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-70e775a6-2e7d-4ed4-8e02-4e896873e55a tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] HTTP exception thrown: Instance 179270ef-7866-4ee7-af13-ec3ea5e7525a could not be found. Apr 14 19:10:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-70e775a6-2e7d-4ed4-8e02-4e896873e55a tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Request method failure captured: Apr 14 19:10:46 user devstack@n-api.service[61673]: request: GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a HTTP/1.1 Apr 14 19:10:46 user devstack@n-api.service[61673]: Accept: application/json Apr 14 19:10:46 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 19:10:46 user devstack@n-api.service[61673]: Connection: close Apr 14 19:10:46 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 19:10:46 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 19:10:46 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 19:10:46 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 19:10:46 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 19:10:46 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOaN8NviZZWivuIogpCJhb-hP7UruUjtByeurIoOdziN-LVB5ZG6sXWjjXi6tDv192ozBb9AxbmHYLx2yXn46BceMqwciJnywhpXZ276wjSu5U7cHLe8Dp1i9V15TcGBnRP3NY86Yd39GiCcmmH-27TsbPeWgxAg3gWGnUO33X7Raw-o Apr 14 19:10:46 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 19:10:46 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 19:10:46 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 19:10:46 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 19:10:46 user devstack@n-api.service[61673]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 19:10:46 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 19:10:46 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 19:10:46 user devstack@n-api.service[61673]: X-Project-Id: ebb0956418bd462c84e1392a74b5ae2e Apr 14 19:10:46 user devstack@n-api.service[61673]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1405261713 Apr 14 19:10:46 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 19:10:46 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 19:10:46 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ebb0956418bd462c84e1392a74b5ae2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ebb0956418bd462c84e1392a74b5ae2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ebb0956418bd462c84e1392a74b5ae2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:10:46 user devstack@n-api.service[61673]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1405261713 Apr 14 19:10:46 user devstack@n-api.service[61673]: X-Tenant-Id: ebb0956418bd462c84e1392a74b5ae2e Apr 14 19:10:46 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1405261713 Apr 14 19:10:46 user devstack@n-api.service[61673]: X-User: tempest-AttachVolumeShelveTestJSON-1405261713-project-member Apr 14 19:10:46 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 19:10:46 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 19:10:46 user devstack@n-api.service[61673]: X-User-Id: 716e5499c6eb483e9c88fd25606018d9 Apr 14 19:10:46 user devstack@n-api.service[61673]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1405261713-project-member Apr 14 19:10:46 user devstack@n-api.service[61673]: method: > Apr 14 19:10:46 user devstack@n-api.service[61673]: exception: Instance 179270ef-7866-4ee7-af13-ec3ea5e7525a could not be found. Apr 14 19:10:46 user devstack@n-api.service[61673]: action_args: {'id': '179270ef-7866-4ee7-af13-ec3ea5e7525a'} Apr 14 19:10:46 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 179270ef-7866-4ee7-af13-ec3ea5e7525a could not be found. Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 179270ef-7866-4ee7-af13-ec3ea5e7525a could not be found. Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 179270ef-7866-4ee7-af13-ec3ea5e7525a could not be found. Apr 14 19:10:46 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:10:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-70e775a6-2e7d-4ed4-8e02-4e896873e55a tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Returning 404 to user: Instance 179270ef-7866-4ee7-af13-ec3ea5e7525a could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:10:46 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-70e775a6-2e7d-4ed4-8e02-4e896873e55a tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a" status: 404 len: 111 microversion: 2.20 time: 0.054726 Apr 14 19:10:46 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 358/1081] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:10:46 2023] GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 19:10:46 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-7b904f36-e37a-46dc-b510-e79d6b6b1044 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '.version_select at 0x7fdae1176320>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:10:46 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:10:46 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:10:46 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:10:46 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-7b904f36-e37a-46dc-b510-e79d6b6b1044 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1365704596" status: 204 len: 0 microversion: 2.20 time: 0.032382 Apr 14 19:10:46 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 364/1082] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 19:10:46 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1365704596 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 14 19:10:47 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:10:47 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=6 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:10:47 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=5 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:10:47 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=5 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:10:47 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-bd9f4aa2-e8c1-4b55-83aa-0ec6c73c9b21 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Action: 'create', calling method: .version_select at 0x7fdae0f16680>, body: {"keypair": {"name": "tempest-keypair-1714568544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlIIFLFsgmEE/cdWpQjb+8JZ3zZZK7ioNqf8TeFKeaiDVMl2nNhJJg/zxBKMinLXJGljsSokaNaV14gZ/dazOcADVQr2+0DMzXCDvHQwDPG9oG9sf5EXCJoMu5yIEfKVw=="}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:10:47 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-bd9f4aa2-e8c1-4b55-83aa-0ec6c73c9b21 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Getting quotas for project ebb0956418bd462c84e1392a74b5ae2e. Resources: {'key_pairs'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 19:10:47 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-bd9f4aa2-e8c1-4b55-83aa-0ec6c73c9b21 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Getting quotas for user 716e5499c6eb483e9c88fd25606018d9 and project ebb0956418bd462c84e1392a74b5ae2e. Resources: {'key_pairs'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 19:10:47 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-bd9f4aa2-e8c1-4b55-83aa-0ec6c73c9b21 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.056705 Apr 14 19:10:47 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 361/1083] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 19:10:47 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 19:10:47 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:10:47 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:10:47 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:47 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:47 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:47 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:47 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:47 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:47 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Going to try to terminate instance {{(pid=61673) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 19:10:47 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0fd6574c-2f67-46a9-838d-81f125c01b13" status: 204 len: 0 microversion: 2.1 time: 0.190989 Apr 14 19:10:47 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 359/1084] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:10:47 2023] DELETE /compute/v2.1/servers/0fd6574c-2f67-46a9-838d-81f125c01b13 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 19:10:47 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-92145f4f-50a7-494f-be6a-93b60f3e0cf0 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:10:47 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-92145f4f-50a7-494f-be6a-93b60f3e0cf0 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:10:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-92145f4f-50a7-494f-be6a-93b60f3e0cf0 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-92145f4f-50a7-494f-be6a-93b60f3e0cf0 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-92145f4f-50a7-494f-be6a-93b60f3e0cf0 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-92145f4f-50a7-494f-be6a-93b60f3e0cf0 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-92145f4f-50a7-494f-be6a-93b60f3e0cf0 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:47 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-92145f4f-50a7-494f-be6a-93b60f3e0cf0 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:48 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-6ef4a68b-5ac4-4a9b-9144-c2924ad0825e req-668b9371-dbf9-4ddf-864e-6f83fb2323be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd6574c-2f67-46a9-838d-81f125c01b13", "name": "network-vif-unplugged", "status": "completed", "tag": "7ac85dee-ddfb-4242-81dd-0e7b659329a8"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:10:48 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-6ef4a68b-5ac4-4a9b-9144-c2924ad0825e req-668b9371-dbf9-4ddf-864e-6f83fb2323be service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:48 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-6ef4a68b-5ac4-4a9b-9144-c2924ad0825e req-668b9371-dbf9-4ddf-864e-6f83fb2323be service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:48 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-6ef4a68b-5ac4-4a9b-9144-c2924ad0825e req-668b9371-dbf9-4ddf-864e-6f83fb2323be service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:48 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-6ef4a68b-5ac4-4a9b-9144-c2924ad0825e req-668b9371-dbf9-4ddf-864e-6f83fb2323be service nova] Creating event network-vif-unplugged:7ac85dee-ddfb-4242-81dd-0e7b659329a8 for instance 0fd6574c-2f67-46a9-838d-81f125c01b13 on user Apr 14 19:10:48 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-92145f4f-50a7-494f-be6a-93b60f3e0cf0 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dda4004af79e4162acea243b475c4fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ba27cb61ba410a875c07ad41d363ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:10:48 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-6ef4a68b-5ac4-4a9b-9144-c2924ad0825e req-668b9371-dbf9-4ddf-864e-6f83fb2323be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032976 Apr 14 19:10:48 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 362/1085] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:10:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:10:48 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-92145f4f-50a7-494f-be6a-93b60f3e0cf0 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fd6574c-2f67-46a9-838d-81f125c01b13" status: 200 len: 1460 microversion: 2.1 time: 0.323496 Apr 14 19:10:48 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 365/1086] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:10:47 2023] GET /compute/v2.1/servers/0fd6574c-2f67-46a9-838d-81f125c01b13 => generated 1460 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:10:49 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-2a2607d8-ce75-4cf8-be1b-37c506ab6af6 req-bf988812-666b-4efe-89fc-6adbdad4a547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd6574c-2f67-46a9-838d-81f125c01b13", "name": "network-vif-deleted", "tag": "7ac85dee-ddfb-4242-81dd-0e7b659329a8"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:10:49 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-2a2607d8-ce75-4cf8-be1b-37c506ab6af6 req-bf988812-666b-4efe-89fc-6adbdad4a547 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:49 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-2a2607d8-ce75-4cf8-be1b-37c506ab6af6 req-bf988812-666b-4efe-89fc-6adbdad4a547 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:49 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-2a2607d8-ce75-4cf8-be1b-37c506ab6af6 req-bf988812-666b-4efe-89fc-6adbdad4a547 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:49 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-2a2607d8-ce75-4cf8-be1b-37c506ab6af6 req-bf988812-666b-4efe-89fc-6adbdad4a547 service nova] Creating event network-vif-deleted:7ac85dee-ddfb-4242-81dd-0e7b659329a8 for instance 0fd6574c-2f67-46a9-838d-81f125c01b13 on user Apr 14 19:10:49 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-2a2607d8-ce75-4cf8-be1b-37c506ab6af6 req-bf988812-666b-4efe-89fc-6adbdad4a547 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042828 Apr 14 19:10:49 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 360/1087] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:10:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:10:50 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1565912159", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "398116e9-945d-474d-918d-f2f5ac726032"}], "security_groups": [{"name": "tempest-securitygroup--734879951"}], "key_name": "tempest-keypair-1714568544", "user_data": "}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:10:50 user devstack@n-api.service[61675]: DEBUG nova.network.neutron [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] validate_networks() for [('398116e9-945d-474d-918d-f2f5ac726032', None, None, None, None, None)] {{(pid=61675) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 19:10:50 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-7f1cdbfe-bee7-4013-b503-712ccb37f81a req-d089cf5a-00a2-42ef-9672-f24b3dd812b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd6574c-2f67-46a9-838d-81f125c01b13", "name": "network-vif-plugged", "status": "completed", "tag": "7ac85dee-ddfb-4242-81dd-0e7b659329a8"}, {"server_uuid": "0fd6574c-2f67-46a9-838d-81f125c01b13", "name": "network-vif-plugged", "status": "completed", "tag": "7ac85dee-ddfb-4242-81dd-0e7b659329a8"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:10:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-7f1cdbfe-bee7-4013-b503-712ccb37f81a req-d089cf5a-00a2-42ef-9672-f24b3dd812b5 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-7f1cdbfe-bee7-4013-b503-712ccb37f81a req-d089cf5a-00a2-42ef-9672-f24b3dd812b5 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-7f1cdbfe-bee7-4013-b503-712ccb37f81a req-d089cf5a-00a2-42ef-9672-f24b3dd812b5 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:50 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-7f1cdbfe-bee7-4013-b503-712ccb37f81a req-d089cf5a-00a2-42ef-9672-f24b3dd812b5 service nova] Creating event network-vif-plugged:7ac85dee-ddfb-4242-81dd-0e7b659329a8 for instance 0fd6574c-2f67-46a9-838d-81f125c01b13 on user Apr 14 19:10:50 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-7f1cdbfe-bee7-4013-b503-712ccb37f81a req-d089cf5a-00a2-42ef-9672-f24b3dd812b5 service nova] Creating event network-vif-plugged:7ac85dee-ddfb-4242-81dd-0e7b659329a8 for instance 0fd6574c-2f67-46a9-838d-81f125c01b13 on user Apr 14 19:10:50 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-7f1cdbfe-bee7-4013-b503-712ccb37f81a req-d089cf5a-00a2-42ef-9672-f24b3dd812b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033734 Apr 14 19:10:50 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 366/1088] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:10:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:10:50 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Flavor limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 19:10:50 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Image limits 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 19:10:50 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Flavor pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 19:10:50 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Image pref 0:0:0 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 19:10:50 user devstack@n-api.service[61675]: DEBUG nova.virt.hardware [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 19:10:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:50 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Getting quotas for project ebb0956418bd462c84e1392a74b5ae2e. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 19:10:50 user devstack@n-api.service[61675]: DEBUG nova.quota [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Getting quotas for user 716e5499c6eb483e9c88fd25606018d9 and project ebb0956418bd462c84e1392a74b5ae2e. Resources: {'ram', 'instances', 'cores'} {{(pid=61675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 19:10:50 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Going to run 1 instances... {{(pid=61675) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 19:10:50 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 19:10:50 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.752748 Apr 14 19:10:50 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 363/1089] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 19:10:50 2023] POST /compute/v2.1/servers => generated 399 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 19:10:50 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-2504fa02-e8f7-4a6e-ac1e-beb5f4d57630 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:10:50 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-2504fa02-e8f7-4a6e-ac1e-beb5f4d57630 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:10:50 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-2504fa02-e8f7-4a6e-ac1e-beb5f4d57630 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:10:50 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-2504fa02-e8f7-4a6e-ac1e-beb5f4d57630 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:10:50 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-2504fa02-e8f7-4a6e-ac1e-beb5f4d57630 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:10:50 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-2504fa02-e8f7-4a6e-ac1e-beb5f4d57630 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed" status: 200 len: 1276 microversion: 2.20 time: 0.080372 Apr 14 19:10:50 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 361/1090] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:10:50 2023] GET /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed => generated 1276 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 19:10:52 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1204816993", "imageRef": "09ac11b8-b53a-4bc5-8785-aad1f28737d3", "flavorRef": "42", "networks": [{"uuid": "0e425031-4fb9-4714-a2fa-c7db4dfb3180"}]}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:10:52 user devstack@n-api.service[61674]: DEBUG nova.network.neutron [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] validate_networks() for [('0e425031-4fb9-4714-a2fa-c7db4dfb3180', None, None, None, None, None)] {{(pid=61674) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 19:10:52 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Flavor limits 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 19:10:52 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Image limits 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 19:10:52 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Flavor pref 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 19:10:52 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Image pref 0:0:0 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 19:10:52 user devstack@n-api.service[61674]: DEBUG nova.virt.hardware [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 19:10:52 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:52 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:52 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:52 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:52 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:52 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:52 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Getting quotas for project 2d0a80ffe2f74c6285fc4586e548872c. Resources: {'ram', 'instances', 'cores'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 19:10:52 user devstack@n-api.service[61674]: DEBUG nova.quota [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Getting quotas for user 267cf755a1894891aa54e8827f9ad392 and project 2d0a80ffe2f74c6285fc4586e548872c. Resources: {'ram', 'instances', 'cores'} {{(pid=61674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 19:10:52 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Going to run 1 instances... {{(pid=61674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 19:10:52 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09ac11b8-b53a-4bc5-8785-aad1f28737d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 19:10:52 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.688139 Apr 14 19:10:52 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 367/1091] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 19:10:52 2023] POST /compute/v2.1/servers => generated 378 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 19:10:52 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-d5c8380e-3f21-4a0a-bd62-088f1ebf8d4a tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:10:52 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-d5c8380e-3f21-4a0a-bd62-088f1ebf8d4a tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:10:53 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-d5c8380e-3f21-4a0a-bd62-088f1ebf8d4a tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cf755a1894891aa54e8827f9ad392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0a80ffe2f74c6285fc4586e548872c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:10:53 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-d5c8380e-3f21-4a0a-bd62-088f1ebf8d4a tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc3a90f6-84b2-4244-a29d-498da82b9a7f" status: 200 len: 1208 microversion: 2.1 time: 0.078793 Apr 14 19:10:53 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 364/1092] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:10:52 2023] GET /compute/v2.1/servers/dc3a90f6-84b2-4244-a29d-498da82b9a7f => generated 1208 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:10:53 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-cdf4e671-3d32-480a-b34c-a60b3bd864a0 req-47ae567f-9b27-456a-b25d-be5a19e0c378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00ddbcca-fe9f-4417-8b6f-96671e666aed", "tag": "9ee81da0-d1c9-443e-b4ea-73648dd076fa"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:10:53 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-cdf4e671-3d32-480a-b34c-a60b3bd864a0 req-47ae567f-9b27-456a-b25d-be5a19e0c378 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:53 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-cdf4e671-3d32-480a-b34c-a60b3bd864a0 req-47ae567f-9b27-456a-b25d-be5a19e0c378 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:53 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-cdf4e671-3d32-480a-b34c-a60b3bd864a0 req-47ae567f-9b27-456a-b25d-be5a19e0c378 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:53 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-cdf4e671-3d32-480a-b34c-a60b3bd864a0 req-47ae567f-9b27-456a-b25d-be5a19e0c378 service nova] Creating event network-changed:9ee81da0-d1c9-443e-b4ea-73648dd076fa for instance 00ddbcca-fe9f-4417-8b6f-96671e666aed on user Apr 14 19:10:53 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-cdf4e671-3d32-480a-b34c-a60b3bd864a0 req-47ae567f-9b27-456a-b25d-be5a19e0c378 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036649 Apr 14 19:10:53 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 362/1093] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:10:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:10:55 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-982eca16-5aaf-4310-adee-905779e65b6a req-381dddf0-883c-409d-bccf-65d1080930e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc3a90f6-84b2-4244-a29d-498da82b9a7f", "tag": "1cb7c282-3494-4134-a152-9b031855bc68"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:10:55 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-982eca16-5aaf-4310-adee-905779e65b6a req-381dddf0-883c-409d-bccf-65d1080930e4 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:55 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-982eca16-5aaf-4310-adee-905779e65b6a req-381dddf0-883c-409d-bccf-65d1080930e4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:55 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-982eca16-5aaf-4310-adee-905779e65b6a req-381dddf0-883c-409d-bccf-65d1080930e4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:55 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-982eca16-5aaf-4310-adee-905779e65b6a req-381dddf0-883c-409d-bccf-65d1080930e4 service nova] Creating event network-changed:1cb7c282-3494-4134-a152-9b031855bc68 for instance dc3a90f6-84b2-4244-a29d-498da82b9a7f on user Apr 14 19:10:55 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-982eca16-5aaf-4310-adee-905779e65b6a req-381dddf0-883c-409d-bccf-65d1080930e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034171 Apr 14 19:10:55 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 368/1094] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:10:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:10:57 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-dbb01faa-0805-4dba-8f37-2b8c226ac56d req-94fbd5f8-5050-446a-947d-f2bc337108f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ddbcca-fe9f-4417-8b6f-96671e666aed", "name": "network-vif-plugged", "status": "completed", "tag": "9ee81da0-d1c9-443e-b4ea-73648dd076fa"}, {"server_uuid": "00ddbcca-fe9f-4417-8b6f-96671e666aed", "name": "network-vif-plugged", "status": "completed", "tag": "9ee81da0-d1c9-443e-b4ea-73648dd076fa"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:10:57 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-dbb01faa-0805-4dba-8f37-2b8c226ac56d req-94fbd5f8-5050-446a-947d-f2bc337108f2 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:57 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-dbb01faa-0805-4dba-8f37-2b8c226ac56d req-94fbd5f8-5050-446a-947d-f2bc337108f2 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:57 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-dbb01faa-0805-4dba-8f37-2b8c226ac56d req-94fbd5f8-5050-446a-947d-f2bc337108f2 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:57 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-dbb01faa-0805-4dba-8f37-2b8c226ac56d req-94fbd5f8-5050-446a-947d-f2bc337108f2 service nova] Creating event network-vif-plugged:9ee81da0-d1c9-443e-b4ea-73648dd076fa for instance 00ddbcca-fe9f-4417-8b6f-96671e666aed on user Apr 14 19:10:57 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-dbb01faa-0805-4dba-8f37-2b8c226ac56d req-94fbd5f8-5050-446a-947d-f2bc337108f2 service nova] Creating event network-vif-plugged:9ee81da0-d1c9-443e-b4ea-73648dd076fa for instance 00ddbcca-fe9f-4417-8b6f-96671e666aed on user Apr 14 19:10:57 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-dbb01faa-0805-4dba-8f37-2b8c226ac56d req-94fbd5f8-5050-446a-947d-f2bc337108f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043369 Apr 14 19:10:57 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 365/1095] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:10:57 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:10:57 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-c72f17a1-b4c6-4d26-8d8a-1e9d684421e3 req-e203e181-5f71-4911-b547-e9abee8a9347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3a90f6-84b2-4244-a29d-498da82b9a7f", "name": "network-vif-plugged", "status": "completed", "tag": "1cb7c282-3494-4134-a152-9b031855bc68"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:10:57 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-c72f17a1-b4c6-4d26-8d8a-1e9d684421e3 req-e203e181-5f71-4911-b547-e9abee8a9347 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:57 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-c72f17a1-b4c6-4d26-8d8a-1e9d684421e3 req-e203e181-5f71-4911-b547-e9abee8a9347 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:57 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-c72f17a1-b4c6-4d26-8d8a-1e9d684421e3 req-e203e181-5f71-4911-b547-e9abee8a9347 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:57 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-c72f17a1-b4c6-4d26-8d8a-1e9d684421e3 req-e203e181-5f71-4911-b547-e9abee8a9347 service nova] Creating event network-vif-plugged:1cb7c282-3494-4134-a152-9b031855bc68 for instance dc3a90f6-84b2-4244-a29d-498da82b9a7f on user Apr 14 19:10:57 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-c72f17a1-b4c6-4d26-8d8a-1e9d684421e3 req-e203e181-5f71-4911-b547-e9abee8a9347 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031188 Apr 14 19:10:57 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 363/1096] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:10:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:10:59 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-561ddf3d-53bd-4190-8511-08a01e933aee req-8ca009af-a1a6-4797-9060-a6a8d3570de4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3a90f6-84b2-4244-a29d-498da82b9a7f", "name": "network-vif-plugged", "status": "completed", "tag": "1cb7c282-3494-4134-a152-9b031855bc68"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:10:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-561ddf3d-53bd-4190-8511-08a01e933aee req-8ca009af-a1a6-4797-9060-a6a8d3570de4 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:10:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-561ddf3d-53bd-4190-8511-08a01e933aee req-8ca009af-a1a6-4797-9060-a6a8d3570de4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:10:59 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-561ddf3d-53bd-4190-8511-08a01e933aee req-8ca009af-a1a6-4797-9060-a6a8d3570de4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:10:59 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-561ddf3d-53bd-4190-8511-08a01e933aee req-8ca009af-a1a6-4797-9060-a6a8d3570de4 service nova] Creating event network-vif-plugged:1cb7c282-3494-4134-a152-9b031855bc68 for instance dc3a90f6-84b2-4244-a29d-498da82b9a7f on user Apr 14 19:10:59 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-561ddf3d-53bd-4190-8511-08a01e933aee req-8ca009af-a1a6-4797-9060-a6a8d3570de4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040851 Apr 14 19:10:59 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 369/1097] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:10:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:11:04 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:11:04 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell0:SELECT=12 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:11:04 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-d81b9019-781f-4463-b229-b72ffba092aa tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:11:04 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-d81b9019-781f-4463-b229-b72ffba092aa tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:11:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d81b9019-781f-4463-b229-b72ffba092aa tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:11:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d81b9019-781f-4463-b229-b72ffba092aa tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:11:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d81b9019-781f-4463-b229-b72ffba092aa tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:11:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d81b9019-781f-4463-b229-b72ffba092aa tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:11:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d81b9019-781f-4463-b229-b72ffba092aa tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:11:04 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-d81b9019-781f-4463-b229-b72ffba092aa tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:11:04 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-d81b9019-781f-4463-b229-b72ffba092aa tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:11:04 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-d81b9019-781f-4463-b229-b72ffba092aa tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be4d9a7a-db6a-4590-9d91-7283024477f8" status: 200 len: 1441 microversion: 2.1 time: 0.437360 Apr 14 19:11:04 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 366/1098] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:11:04 2023] GET /compute/v2.1/servers/be4d9a7a-db6a-4590-9d91-7283024477f8 => generated 1441 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:11:06 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell0:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:11:06 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-3f97f39d-ece2-4fd6-9a72-741be05b55ee req-4bd56c6a-b70b-4a6f-b79f-00e50cbcfbad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be4d9a7a-db6a-4590-9d91-7283024477f8", "tag": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:11:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-3f97f39d-ece2-4fd6-9a72-741be05b55ee req-4bd56c6a-b70b-4a6f-b79f-00e50cbcfbad service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:11:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-3f97f39d-ece2-4fd6-9a72-741be05b55ee req-4bd56c6a-b70b-4a6f-b79f-00e50cbcfbad service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:11:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-3f97f39d-ece2-4fd6-9a72-741be05b55ee req-4bd56c6a-b70b-4a6f-b79f-00e50cbcfbad service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:11:06 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-3f97f39d-ece2-4fd6-9a72-741be05b55ee req-4bd56c6a-b70b-4a6f-b79f-00e50cbcfbad service nova] Creating event network-changed:1ec8a1a9-4379-425f-90c0-7781c1bf8e7d for instance be4d9a7a-db6a-4590-9d91-7283024477f8 on user Apr 14 19:11:06 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-3f97f39d-ece2-4fd6-9a72-741be05b55ee req-4bd56c6a-b70b-4a6f-b79f-00e50cbcfbad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040238 Apr 14 19:11:06 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 364/1099] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:11:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:11:08 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:11:08 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell0:SELECT=6 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:11:08 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:11:08 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:11:08 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-5361ef8a-133b-4eaa-be8f-0ded08c3d26c req-64fc3edd-a81d-4467-bba6-cbb67589314a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be4d9a7a-db6a-4590-9d91-7283024477f8", "tag": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:11:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:11:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:11:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:11:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-5361ef8a-133b-4eaa-be8f-0ded08c3d26c req-64fc3edd-a81d-4467-bba6-cbb67589314a service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:11:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-5361ef8a-133b-4eaa-be8f-0ded08c3d26c req-64fc3edd-a81d-4467-bba6-cbb67589314a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:11:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:11:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-5361ef8a-133b-4eaa-be8f-0ded08c3d26c req-64fc3edd-a81d-4467-bba6-cbb67589314a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:11:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:11:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:11:08 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-5361ef8a-133b-4eaa-be8f-0ded08c3d26c req-64fc3edd-a81d-4467-bba6-cbb67589314a service nova] Creating event network-changed:1ec8a1a9-4379-425f-90c0-7781c1bf8e7d for instance be4d9a7a-db6a-4590-9d91-7283024477f8 on user Apr 14 19:11:08 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-5361ef8a-133b-4eaa-be8f-0ded08c3d26c req-64fc3edd-a81d-4467-bba6-cbb67589314a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028841 Apr 14 19:11:08 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 367/1100] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:11:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:11:08 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Going to try to terminate instance {{(pid=61674) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 19:11:08 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/be4d9a7a-db6a-4590-9d91-7283024477f8" status: 204 len: 0 microversion: 2.1 time: 0.140814 Apr 14 19:11:08 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 370/1101] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:11:08 2023] DELETE /compute/v2.1/servers/be4d9a7a-db6a-4590-9d91-7283024477f8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 19:11:08 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-200bdb86-d0b1-441a-a5bf-2474a94cc262 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:11:08 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-200bdb86-d0b1-441a-a5bf-2474a94cc262 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:11:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-200bdb86-d0b1-441a-a5bf-2474a94cc262 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:11:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-200bdb86-d0b1-441a-a5bf-2474a94cc262 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:11:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-200bdb86-d0b1-441a-a5bf-2474a94cc262 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:11:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-200bdb86-d0b1-441a-a5bf-2474a94cc262 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:11:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-200bdb86-d0b1-441a-a5bf-2474a94cc262 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:11:08 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-200bdb86-d0b1-441a-a5bf-2474a94cc262 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:11:08 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-200bdb86-d0b1-441a-a5bf-2474a94cc262 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:11:08 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-200bdb86-d0b1-441a-a5bf-2474a94cc262 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be4d9a7a-db6a-4590-9d91-7283024477f8" status: 200 len: 1564 microversion: 2.1 time: 0.331595 Apr 14 19:11:08 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 365/1102] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:11:08 2023] GET /compute/v2.1/servers/be4d9a7a-db6a-4590-9d91-7283024477f8 => generated 1564 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:11:09 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-6837e7aa-3fd8-4bd9-9204-ddbda23c6ac6 req-e1caa7ef-b9f0-4c4e-9b5b-51f173926aef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be4d9a7a-db6a-4590-9d91-7283024477f8", "name": "network-vif-deleted", "tag": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:11:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-6837e7aa-3fd8-4bd9-9204-ddbda23c6ac6 req-e1caa7ef-b9f0-4c4e-9b5b-51f173926aef service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:11:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-6837e7aa-3fd8-4bd9-9204-ddbda23c6ac6 req-e1caa7ef-b9f0-4c4e-9b5b-51f173926aef service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:11:09 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-6837e7aa-3fd8-4bd9-9204-ddbda23c6ac6 req-e1caa7ef-b9f0-4c4e-9b5b-51f173926aef service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:11:09 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-6837e7aa-3fd8-4bd9-9204-ddbda23c6ac6 req-e1caa7ef-b9f0-4c4e-9b5b-51f173926aef service nova] Creating event network-vif-deleted:1ec8a1a9-4379-425f-90c0-7781c1bf8e7d for instance be4d9a7a-db6a-4590-9d91-7283024477f8 on user Apr 14 19:11:09 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-6837e7aa-3fd8-4bd9-9204-ddbda23c6ac6 req-e1caa7ef-b9f0-4c4e-9b5b-51f173926aef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027544 Apr 14 19:11:09 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 368/1103] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:11:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:11:10 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-15f04036-cefe-49c9-842f-ac2069d8ebc9 req-5dcf244c-857e-41e4-946c-02b5f1ca0a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be4d9a7a-db6a-4590-9d91-7283024477f8", "name": "network-vif-unplugged", "status": "completed", "tag": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d"}, {"server_uuid": "be4d9a7a-db6a-4590-9d91-7283024477f8", "name": "network-vif-plugged", "status": "completed", "tag": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:11:10 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-15f04036-cefe-49c9-842f-ac2069d8ebc9 req-5dcf244c-857e-41e4-946c-02b5f1ca0a47 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:11:10 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-15f04036-cefe-49c9-842f-ac2069d8ebc9 req-5dcf244c-857e-41e4-946c-02b5f1ca0a47 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:11:10 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-15f04036-cefe-49c9-842f-ac2069d8ebc9 req-5dcf244c-857e-41e4-946c-02b5f1ca0a47 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:11:10 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-15f04036-cefe-49c9-842f-ac2069d8ebc9 req-5dcf244c-857e-41e4-946c-02b5f1ca0a47 service nova] Creating event network-vif-unplugged:1ec8a1a9-4379-425f-90c0-7781c1bf8e7d for instance be4d9a7a-db6a-4590-9d91-7283024477f8 on user Apr 14 19:11:10 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-15f04036-cefe-49c9-842f-ac2069d8ebc9 req-5dcf244c-857e-41e4-946c-02b5f1ca0a47 service nova] Creating event network-vif-plugged:1ec8a1a9-4379-425f-90c0-7781c1bf8e7d for instance be4d9a7a-db6a-4590-9d91-7283024477f8 on user Apr 14 19:11:10 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-15f04036-cefe-49c9-842f-ac2069d8ebc9 req-5dcf244c-857e-41e4-946c-02b5f1ca0a47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.034948 Apr 14 19:11:10 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 371/1104] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:11:10 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:11:13 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-dab7d5a3-471b-4e20-a911-ebe9fcb124f1 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:11:13 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-dab7d5a3-471b-4e20-a911-ebe9fcb124f1 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:11:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-dab7d5a3-471b-4e20-a911-ebe9fcb124f1 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:11:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-dab7d5a3-471b-4e20-a911-ebe9fcb124f1 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:11:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-dab7d5a3-471b-4e20-a911-ebe9fcb124f1 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:11:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-dab7d5a3-471b-4e20-a911-ebe9fcb124f1 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:11:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-dab7d5a3-471b-4e20-a911-ebe9fcb124f1 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:11:13 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-dab7d5a3-471b-4e20-a911-ebe9fcb124f1 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:11:14 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-dab7d5a3-471b-4e20-a911-ebe9fcb124f1 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1b6efb65b541ef992b66d9d06bd03f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f71b0490e5a4d3b9300dc510b936a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:11:14 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-dab7d5a3-471b-4e20-a911-ebe9fcb124f1 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3fa57cc-781a-402e-91fc-e4ee5640960b" status: 200 len: 1486 microversion: 2.1 time: 0.227084 Apr 14 19:11:14 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 366/1105] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:11:13 2023] GET /compute/v2.1/servers/e3fa57cc-781a-402e-91fc-e4ee5640960b => generated 1486 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 19:11:19 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-7aea9627-eae0-44d7-9a36-4b71cba44b3e tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:11:19 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-7aea9627-eae0-44d7-9a36-4b71cba44b3e tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:11:19 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=4 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:11:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7aea9627-eae0-44d7-9a36-4b71cba44b3e tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:11:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7aea9627-eae0-44d7-9a36-4b71cba44b3e tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:11:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7aea9627-eae0-44d7-9a36-4b71cba44b3e tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:11:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7aea9627-eae0-44d7-9a36-4b71cba44b3e tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:11:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7aea9627-eae0-44d7-9a36-4b71cba44b3e tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:11:19 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7aea9627-eae0-44d7-9a36-4b71cba44b3e tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:11:19 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=17 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:11:19 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-7aea9627-eae0-44d7-9a36-4b71cba44b3e tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] HTTP exception thrown: Instance a9379580-fd2f-4468-9ed3-7109735195be could not be found. Apr 14 19:11:19 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-7aea9627-eae0-44d7-9a36-4b71cba44b3e tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Request method failure captured: Apr 14 19:11:19 user devstack@n-api.service[61675]: request: GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be HTTP/1.1 Apr 14 19:11:19 user devstack@n-api.service[61675]: Accept: application/json Apr 14 19:11:19 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 19:11:19 user devstack@n-api.service[61675]: Connection: close Apr 14 19:11:19 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 19:11:19 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 19:11:19 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 19:11:19 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 19:11:19 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 19:11:19 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOaOG1yERbKtsBmrEZ1wQ5a3aWHP4h-RspR6khEi2JeG92X5ygMCkj5pzNAbucp9iNNnw8AnMkZndhL1aqbZeV5hKyTCCjfrR-WUBV8EtHHrcBNp3fMoonNiBq1E3MYtm-tkg5pZN0794JoWE575DnBjEDd7VX2ebLYhqrqRrYZrB964 Apr 14 19:11:19 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 19:11:19 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 19:11:19 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 19:11:19 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 19:11:19 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 19:11:19 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 19:11:19 user devstack@n-api.service[61675]: X-Project-Id: 81575e6ed9bc41d2ad2ac1ad0fbd253d Apr 14 19:11:19 user devstack@n-api.service[61675]: X-Project-Name: tempest-SnapshotDataIntegrityTests-593938196 Apr 14 19:11:19 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 19:11:19 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 19:11:19 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/81575e6ed9bc41d2ad2ac1ad0fbd253d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/81575e6ed9bc41d2ad2ac1ad0fbd253d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/81575e6ed9bc41d2ad2ac1ad0fbd253d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:11:19 user devstack@n-api.service[61675]: X-Tenant: tempest-SnapshotDataIntegrityTests-593938196 Apr 14 19:11:19 user devstack@n-api.service[61675]: X-Tenant-Id: 81575e6ed9bc41d2ad2ac1ad0fbd253d Apr 14 19:11:19 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-593938196 Apr 14 19:11:19 user devstack@n-api.service[61675]: X-User: tempest-SnapshotDataIntegrityTests-593938196-project-member Apr 14 19:11:19 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 19:11:19 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 19:11:19 user devstack@n-api.service[61675]: X-User-Id: 10cf3683f78d4724bb734e5280e8736b Apr 14 19:11:19 user devstack@n-api.service[61675]: X-User-Name: tempest-SnapshotDataIntegrityTests-593938196-project-member Apr 14 19:11:19 user devstack@n-api.service[61675]: method: > Apr 14 19:11:19 user devstack@n-api.service[61675]: exception: Instance a9379580-fd2f-4468-9ed3-7109735195be could not be found. Apr 14 19:11:19 user devstack@n-api.service[61675]: action_args: {'id': 'a9379580-fd2f-4468-9ed3-7109735195be'} Apr 14 19:11:19 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9379580-fd2f-4468-9ed3-7109735195be could not be found. Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9379580-fd2f-4468-9ed3-7109735195be could not be found. Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9379580-fd2f-4468-9ed3-7109735195be could not be found. Apr 14 19:11:19 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:11:19 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-7aea9627-eae0-44d7-9a36-4b71cba44b3e tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Returning 404 to user: Instance a9379580-fd2f-4468-9ed3-7109735195be could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:11:19 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-7aea9627-eae0-44d7-9a36-4b71cba44b3e tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be" status: 404 len: 111 microversion: 2.1 time: 0.034122 Apr 14 19:11:19 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 369/1106] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:11:19 2023] GET /compute/v2.1/servers/a9379580-fd2f-4468-9ed3-7109735195be => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:11:20 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:11:20 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:11:20 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-a83ce177-c1be-40f5-9259-b500653fb6cf tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Calling method '.version_select at 0x7fdae1442cb0>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:11:20 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-a83ce177-c1be-40f5-9259-b500653fb6cf tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1211605812" status: 202 len: 0 microversion: 2.1 time: 0.053100 Apr 14 19:11:20 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 372/1107] 10.0.0.210 () {62 vars in 1355 bytes} [Fri Apr 14 19:11:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1211605812 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 19:11:38 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-91bded5f-9436-4cc4-b298-abb22951a1d6 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:11:38 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-91bded5f-9436-4cc4-b298-abb22951a1d6 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:11:38 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:11:38 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:11:38 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-91bded5f-9436-4cc4-b298-abb22951a1d6 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:11:38 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-91bded5f-9436-4cc4-b298-abb22951a1d6 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:11:38 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-91bded5f-9436-4cc4-b298-abb22951a1d6 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:11:38 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-91bded5f-9436-4cc4-b298-abb22951a1d6 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:11:38 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-91bded5f-9436-4cc4-b298-abb22951a1d6 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:11:38 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-91bded5f-9436-4cc4-b298-abb22951a1d6 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:11:38 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-91bded5f-9436-4cc4-b298-abb22951a1d6 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] HTTP exception thrown: Instance 0fd6574c-2f67-46a9-838d-81f125c01b13 could not be found. Apr 14 19:11:38 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-91bded5f-9436-4cc4-b298-abb22951a1d6 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Request method failure captured: Apr 14 19:11:38 user devstack@n-api.service[61673]: request: GET /compute/v2.1/servers/0fd6574c-2f67-46a9-838d-81f125c01b13 HTTP/1.1 Apr 14 19:11:38 user devstack@n-api.service[61673]: Accept: application/json Apr 14 19:11:38 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 19:11:38 user devstack@n-api.service[61673]: Connection: close Apr 14 19:11:38 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 19:11:38 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 19:11:38 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 19:11:38 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 19:11:38 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 19:11:38 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOaTGPWmSDkSPIgEABKXY5cyAR5LmRIh_NLm9MwwLKGyh1rgQe7gF97msCzCbXO3sZQ6alH9xfY47RQnRkZiIojSjzxtt-VrfWTwyIm9pndfuLwjVirULTa6mZl4jYAMRbni3URAFW-UJYQhHatU4Cay63s_tc3ozMzUr9IBTcCbeLUs Apr 14 19:11:38 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 19:11:38 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 19:11:38 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 19:11:38 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 19:11:38 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 19:11:38 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 19:11:38 user devstack@n-api.service[61673]: X-Project-Id: f7ba27cb61ba410a875c07ad41d363ba Apr 14 19:11:38 user devstack@n-api.service[61673]: X-Project-Name: tempest-VolumesNegativeTest-1776527759 Apr 14 19:11:38 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 19:11:38 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 19:11:38 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f7ba27cb61ba410a875c07ad41d363ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f7ba27cb61ba410a875c07ad41d363ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f7ba27cb61ba410a875c07ad41d363ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:11:38 user devstack@n-api.service[61673]: X-Tenant: tempest-VolumesNegativeTest-1776527759 Apr 14 19:11:38 user devstack@n-api.service[61673]: X-Tenant-Id: f7ba27cb61ba410a875c07ad41d363ba Apr 14 19:11:38 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-VolumesNegativeTest-1776527759 Apr 14 19:11:38 user devstack@n-api.service[61673]: X-User: tempest-VolumesNegativeTest-1776527759-project-member Apr 14 19:11:38 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 19:11:38 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 19:11:38 user devstack@n-api.service[61673]: X-User-Id: dda4004af79e4162acea243b475c4fad Apr 14 19:11:38 user devstack@n-api.service[61673]: X-User-Name: tempest-VolumesNegativeTest-1776527759-project-member Apr 14 19:11:38 user devstack@n-api.service[61673]: method: > Apr 14 19:11:38 user devstack@n-api.service[61673]: exception: Instance 0fd6574c-2f67-46a9-838d-81f125c01b13 could not be found. Apr 14 19:11:38 user devstack@n-api.service[61673]: action_args: {'id': '0fd6574c-2f67-46a9-838d-81f125c01b13'} Apr 14 19:11:38 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fd6574c-2f67-46a9-838d-81f125c01b13 could not be found. Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fd6574c-2f67-46a9-838d-81f125c01b13 could not be found. Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fd6574c-2f67-46a9-838d-81f125c01b13 could not be found. Apr 14 19:11:38 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:11:38 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-91bded5f-9436-4cc4-b298-abb22951a1d6 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Returning 404 to user: Instance 0fd6574c-2f67-46a9-838d-81f125c01b13 could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:11:38 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-91bded5f-9436-4cc4-b298-abb22951a1d6 tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fd6574c-2f67-46a9-838d-81f125c01b13" status: 404 len: 111 microversion: 2.1 time: 0.034473 Apr 14 19:11:38 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 367/1108] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:11:38 2023] GET /compute/v2.1/servers/0fd6574c-2f67-46a9-838d-81f125c01b13 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:11:41 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-51e64386-3d12-48f8-abe5-2a0badf981c1 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:11:41 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-51e64386-3d12-48f8-abe5-2a0badf981c1 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:11:41 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:11:41 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:11:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-51e64386-3d12-48f8-abe5-2a0badf981c1 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:11:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-51e64386-3d12-48f8-abe5-2a0badf981c1 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:11:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-51e64386-3d12-48f8-abe5-2a0badf981c1 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:11:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-51e64386-3d12-48f8-abe5-2a0badf981c1 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:11:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-51e64386-3d12-48f8-abe5-2a0badf981c1 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:11:41 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-51e64386-3d12-48f8-abe5-2a0badf981c1 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:11:41 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-51e64386-3d12-48f8-abe5-2a0badf981c1 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:11:41 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-51e64386-3d12-48f8-abe5-2a0badf981c1 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:11:41 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-51e64386-3d12-48f8-abe5-2a0badf981c1 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:11:41 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-51e64386-3d12-48f8-abe5-2a0badf981c1 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed" status: 200 len: 1588 microversion: 2.20 time: 0.251354 Apr 14 19:11:41 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 370/1109] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:11:41 2023] GET /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed => generated 1588 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 19:11:43 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-04a3e443-899d-4453-9501-0b7f3c761113 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:11:43 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-04a3e443-899d-4453-9501-0b7f3c761113 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:11:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-04a3e443-899d-4453-9501-0b7f3c761113 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:11:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-04a3e443-899d-4453-9501-0b7f3c761113 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:11:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-04a3e443-899d-4453-9501-0b7f3c761113 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:11:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-04a3e443-899d-4453-9501-0b7f3c761113 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:11:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-04a3e443-899d-4453-9501-0b7f3c761113 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:11:43 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-04a3e443-899d-4453-9501-0b7f3c761113 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:11:43 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-04a3e443-899d-4453-9501-0b7f3c761113 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cf755a1894891aa54e8827f9ad392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0a80ffe2f74c6285fc4586e548872c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:11:43 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-04a3e443-899d-4453-9501-0b7f3c761113 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc3a90f6-84b2-4244-a29d-498da82b9a7f" status: 200 len: 1486 microversion: 2.1 time: 0.403292 Apr 14 19:11:43 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 373/1110] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:11:43 2023] GET /compute/v2.1/servers/dc3a90f6-84b2-4244-a29d-498da82b9a7f => generated 1486 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:11:58 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:11:58 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-4a06f5a3-4415-4f19-9fa6-c6255f35046a tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:11:58 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-4a06f5a3-4415-4f19-9fa6-c6255f35046a tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:11:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4a06f5a3-4415-4f19-9fa6-c6255f35046a tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:11:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4a06f5a3-4415-4f19-9fa6-c6255f35046a tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:11:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4a06f5a3-4415-4f19-9fa6-c6255f35046a tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:11:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4a06f5a3-4415-4f19-9fa6-c6255f35046a tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:11:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4a06f5a3-4415-4f19-9fa6-c6255f35046a tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:11:58 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-4a06f5a3-4415-4f19-9fa6-c6255f35046a tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:11:58 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-4a06f5a3-4415-4f19-9fa6-c6255f35046a tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] HTTP exception thrown: Instance be4d9a7a-db6a-4590-9d91-7283024477f8 could not be found. Apr 14 19:11:58 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-4a06f5a3-4415-4f19-9fa6-c6255f35046a tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Request method failure captured: Apr 14 19:11:58 user devstack@n-api.service[61673]: request: GET /compute/v2.1/servers/be4d9a7a-db6a-4590-9d91-7283024477f8 HTTP/1.1 Apr 14 19:11:58 user devstack@n-api.service[61673]: Accept: application/json Apr 14 19:11:58 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 19:11:58 user devstack@n-api.service[61673]: Connection: close Apr 14 19:11:58 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 19:11:58 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 19:11:58 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 19:11:58 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 19:11:58 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 19:11:58 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOaGjzEHP4gR4MoApqz0vJpRX2_SvaMHlWJEk_fU7mYw99OWl-qUsSQ6rEQ6kqDrRwocqp34lWfQib95-KwgiyuwPlyVpsmwfmwLReClbkEHff7utOAgEbSdfwWoPS9VLZQQ0SJcp_M6aCZY6cryOh5BrJ2VueTzigMFoaeOsa0D5fWA Apr 14 19:11:58 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 19:11:58 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 19:11:58 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 19:11:58 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 19:11:58 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 19:11:58 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 19:11:58 user devstack@n-api.service[61673]: X-Project-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 19:11:58 user devstack@n-api.service[61673]: X-Project-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:11:58 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 19:11:58 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 19:11:58 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:11:58 user devstack@n-api.service[61673]: X-Tenant: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:11:58 user devstack@n-api.service[61673]: X-Tenant-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 19:11:58 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:11:58 user devstack@n-api.service[61673]: X-User: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 19:11:58 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 19:11:58 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 19:11:58 user devstack@n-api.service[61673]: X-User-Id: fc3bed70703a49c8bdec2f50193c7f70 Apr 14 19:11:58 user devstack@n-api.service[61673]: X-User-Name: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 19:11:58 user devstack@n-api.service[61673]: method: > Apr 14 19:11:58 user devstack@n-api.service[61673]: exception: Instance be4d9a7a-db6a-4590-9d91-7283024477f8 could not be found. Apr 14 19:11:58 user devstack@n-api.service[61673]: action_args: {'id': 'be4d9a7a-db6a-4590-9d91-7283024477f8'} Apr 14 19:11:58 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be4d9a7a-db6a-4590-9d91-7283024477f8 could not be found. Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be4d9a7a-db6a-4590-9d91-7283024477f8 could not be found. Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be4d9a7a-db6a-4590-9d91-7283024477f8 could not be found. Apr 14 19:11:58 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:11:58 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-4a06f5a3-4415-4f19-9fa6-c6255f35046a tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Returning 404 to user: Instance be4d9a7a-db6a-4590-9d91-7283024477f8 could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:11:58 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-4a06f5a3-4415-4f19-9fa6-c6255f35046a tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be4d9a7a-db6a-4590-9d91-7283024477f8" status: 404 len: 111 microversion: 2.1 time: 0.271682 Apr 14 19:11:58 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 368/1111] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:11:58 2023] GET /compute/v2.1/servers/be4d9a7a-db6a-4590-9d91-7283024477f8 => generated 111 bytes in 273 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 19:12:06 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:12:06 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:12:06 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:12:06 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-a8c42895-8e4c-489a-ac35-4030fcd3bf63 req-cc119675-3f55-4dbc-ad82-3d94fb0c440a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "935022b4-4ba7-4b34-a758-a00081240b4c", "tag": "ef166576-430e-47da-b169-915c4a0cd97c"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:12:06 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=6 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:12:06 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:12:06 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=6 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:12:06 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:06 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:06 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:06 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:06 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:06 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-a8c42895-8e4c-489a-ac35-4030fcd3bf63 req-cc119675-3f55-4dbc-ad82-3d94fb0c440a service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-a8c42895-8e4c-489a-ac35-4030fcd3bf63 req-cc119675-3f55-4dbc-ad82-3d94fb0c440a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:06 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-a8c42895-8e4c-489a-ac35-4030fcd3bf63 req-cc119675-3f55-4dbc-ad82-3d94fb0c440a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:06 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-a8c42895-8e4c-489a-ac35-4030fcd3bf63 req-cc119675-3f55-4dbc-ad82-3d94fb0c440a service nova] Creating event network-changed:ef166576-430e-47da-b169-915c4a0cd97c for instance 935022b4-4ba7-4b34-a758-a00081240b4c on user Apr 14 19:12:06 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-a8c42895-8e4c-489a-ac35-4030fcd3bf63 req-cc119675-3f55-4dbc-ad82-3d94fb0c440a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035555 Apr 14 19:12:06 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 374/1112] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:12:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:12:06 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Going to try to terminate instance {{(pid=61675) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 19:12:06 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/935022b4-4ba7-4b34-a758-a00081240b4c" status: 204 len: 0 microversion: 2.1 time: 0.125105 Apr 14 19:12:06 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 371/1113] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:12:06 2023] DELETE /compute/v2.1/servers/935022b4-4ba7-4b34-a758-a00081240b4c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 19:12:06 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-f01df237-a6b3-4e2f-af65-d4b2b7fbe225 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:12:06 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-f01df237-a6b3-4e2f-af65-d4b2b7fbe225 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:12:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f01df237-a6b3-4e2f-af65-d4b2b7fbe225 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f01df237-a6b3-4e2f-af65-d4b2b7fbe225 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f01df237-a6b3-4e2f-af65-d4b2b7fbe225 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f01df237-a6b3-4e2f-af65-d4b2b7fbe225 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f01df237-a6b3-4e2f-af65-d4b2b7fbe225 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:06 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-f01df237-a6b3-4e2f-af65-d4b2b7fbe225 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:06 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-f01df237-a6b3-4e2f-af65-d4b2b7fbe225 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:12:06 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-f01df237-a6b3-4e2f-af65-d4b2b7fbe225 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/935022b4-4ba7-4b34-a758-a00081240b4c" status: 200 len: 1565 microversion: 2.1 time: 0.312099 Apr 14 19:12:06 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 369/1114] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:12:06 2023] GET /compute/v2.1/servers/935022b4-4ba7-4b34-a758-a00081240b4c => generated 1565 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:12:08 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-ed8420aa-f7d8-45ff-95d1-ca4bc40333b4 req-ef706788-311c-44c2-97ac-a0ac15ba3d0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "935022b4-4ba7-4b34-a758-a00081240b4c", "name": "network-vif-unplugged", "status": "completed", "tag": "ef166576-430e-47da-b169-915c4a0cd97c"}, {"server_uuid": "935022b4-4ba7-4b34-a758-a00081240b4c", "name": "network-vif-plugged", "status": "completed", "tag": "ef166576-430e-47da-b169-915c4a0cd97c"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:12:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-ed8420aa-f7d8-45ff-95d1-ca4bc40333b4 req-ef706788-311c-44c2-97ac-a0ac15ba3d0f service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-ed8420aa-f7d8-45ff-95d1-ca4bc40333b4 req-ef706788-311c-44c2-97ac-a0ac15ba3d0f service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:08 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-ed8420aa-f7d8-45ff-95d1-ca4bc40333b4 req-ef706788-311c-44c2-97ac-a0ac15ba3d0f service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:08 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-ed8420aa-f7d8-45ff-95d1-ca4bc40333b4 req-ef706788-311c-44c2-97ac-a0ac15ba3d0f service nova] Creating event network-vif-unplugged:ef166576-430e-47da-b169-915c4a0cd97c for instance 935022b4-4ba7-4b34-a758-a00081240b4c on user Apr 14 19:12:08 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-ed8420aa-f7d8-45ff-95d1-ca4bc40333b4 req-ef706788-311c-44c2-97ac-a0ac15ba3d0f service nova] Creating event network-vif-plugged:ef166576-430e-47da-b169-915c4a0cd97c for instance 935022b4-4ba7-4b34-a758-a00081240b4c on user Apr 14 19:12:08 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-ed8420aa-f7d8-45ff-95d1-ca4bc40333b4 req-ef706788-311c-44c2-97ac-a0ac15ba3d0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.032902 Apr 14 19:12:08 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 375/1115] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:12:08 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:12:08 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-9d14a681-aaf6-46ff-8056-269456d214b6 req-67f4aa5c-723d-40be-a51e-e57167c1e369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "935022b4-4ba7-4b34-a758-a00081240b4c", "name": "network-vif-deleted", "tag": "ef166576-430e-47da-b169-915c4a0cd97c"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:12:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-9d14a681-aaf6-46ff-8056-269456d214b6 req-67f4aa5c-723d-40be-a51e-e57167c1e369 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-9d14a681-aaf6-46ff-8056-269456d214b6 req-67f4aa5c-723d-40be-a51e-e57167c1e369 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:08 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-9d14a681-aaf6-46ff-8056-269456d214b6 req-67f4aa5c-723d-40be-a51e-e57167c1e369 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:08 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-9d14a681-aaf6-46ff-8056-269456d214b6 req-67f4aa5c-723d-40be-a51e-e57167c1e369 service nova] Creating event network-vif-deleted:ef166576-430e-47da-b169-915c4a0cd97c for instance 935022b4-4ba7-4b34-a758-a00081240b4c on user Apr 14 19:12:08 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-9d14a681-aaf6-46ff-8056-269456d214b6 req-67f4aa5c-723d-40be-a51e-e57167c1e369 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029166 Apr 14 19:12:08 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 372/1116] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:12:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:12:14 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:12:14 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:12:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:14 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:14 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Going to try to terminate instance {{(pid=61673) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 19:12:14 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e3fa57cc-781a-402e-91fc-e4ee5640960b" status: 204 len: 0 microversion: 2.1 time: 0.110552 Apr 14 19:12:14 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 370/1117] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:12:14 2023] DELETE /compute/v2.1/servers/e3fa57cc-781a-402e-91fc-e4ee5640960b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 19:12:14 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-fd71ef65-8fee-4a7b-a6c7-c2dc9865632c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:12:14 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-fd71ef65-8fee-4a7b-a6c7-c2dc9865632c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:12:14 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fd71ef65-8fee-4a7b-a6c7-c2dc9865632c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:14 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fd71ef65-8fee-4a7b-a6c7-c2dc9865632c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:14 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fd71ef65-8fee-4a7b-a6c7-c2dc9865632c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:14 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fd71ef65-8fee-4a7b-a6c7-c2dc9865632c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:14 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fd71ef65-8fee-4a7b-a6c7-c2dc9865632c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:14 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-fd71ef65-8fee-4a7b-a6c7-c2dc9865632c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:15 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-1be9a93d-c47a-48bc-beee-84a1d5587403 req-cacb89e6-bcd7-4316-8841-4f81b7f73e7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3fa57cc-781a-402e-91fc-e4ee5640960b", "name": "network-vif-unplugged", "status": "completed", "tag": "2446f800-78b9-4e6d-80cb-23be097676bd"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:12:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-1be9a93d-c47a-48bc-beee-84a1d5587403 req-cacb89e6-bcd7-4316-8841-4f81b7f73e7c service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-1be9a93d-c47a-48bc-beee-84a1d5587403 req-cacb89e6-bcd7-4316-8841-4f81b7f73e7c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:15 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-1be9a93d-c47a-48bc-beee-84a1d5587403 req-cacb89e6-bcd7-4316-8841-4f81b7f73e7c service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:15 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-1be9a93d-c47a-48bc-beee-84a1d5587403 req-cacb89e6-bcd7-4316-8841-4f81b7f73e7c service nova] Creating event network-vif-unplugged:2446f800-78b9-4e6d-80cb-23be097676bd for instance e3fa57cc-781a-402e-91fc-e4ee5640960b on user Apr 14 19:12:15 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-1be9a93d-c47a-48bc-beee-84a1d5587403 req-cacb89e6-bcd7-4316-8841-4f81b7f73e7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035093 Apr 14 19:12:15 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 373/1118] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:12:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:12:15 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-fd71ef65-8fee-4a7b-a6c7-c2dc9865632c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1b6efb65b541ef992b66d9d06bd03f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f71b0490e5a4d3b9300dc510b936a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:12:15 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-fd71ef65-8fee-4a7b-a6c7-c2dc9865632c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3fa57cc-781a-402e-91fc-e4ee5640960b" status: 200 len: 1492 microversion: 2.1 time: 0.251326 Apr 14 19:12:15 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 376/1119] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:12:14 2023] GET /compute/v2.1/servers/e3fa57cc-781a-402e-91fc-e4ee5640960b => generated 1492 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:12:16 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-65d690ec-2660-4eff-9da0-2da2aa0d311d req-3fd30160-47ba-4848-ad4b-67f0be145da4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3fa57cc-781a-402e-91fc-e4ee5640960b", "name": "network-vif-deleted", "tag": "2446f800-78b9-4e6d-80cb-23be097676bd"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:12:16 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-65d690ec-2660-4eff-9da0-2da2aa0d311d req-3fd30160-47ba-4848-ad4b-67f0be145da4 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:16 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-65d690ec-2660-4eff-9da0-2da2aa0d311d req-3fd30160-47ba-4848-ad4b-67f0be145da4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:16 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-65d690ec-2660-4eff-9da0-2da2aa0d311d req-3fd30160-47ba-4848-ad4b-67f0be145da4 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:16 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-65d690ec-2660-4eff-9da0-2da2aa0d311d req-3fd30160-47ba-4848-ad4b-67f0be145da4 service nova] Creating event network-vif-deleted:2446f800-78b9-4e6d-80cb-23be097676bd for instance e3fa57cc-781a-402e-91fc-e4ee5640960b on user Apr 14 19:12:16 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-65d690ec-2660-4eff-9da0-2da2aa0d311d req-3fd30160-47ba-4848-ad4b-67f0be145da4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031432 Apr 14 19:12:16 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 371/1120] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:12:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:12:17 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-6fab3356-9b45-4a0e-934f-51cf7fb2f938 req-4cfa931f-fd59-46e0-8d1a-2d22af17c29f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3fa57cc-781a-402e-91fc-e4ee5640960b", "name": "network-vif-plugged", "status": "completed", "tag": "2446f800-78b9-4e6d-80cb-23be097676bd"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:12:17 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-6fab3356-9b45-4a0e-934f-51cf7fb2f938 req-4cfa931f-fd59-46e0-8d1a-2d22af17c29f service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:17 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-6fab3356-9b45-4a0e-934f-51cf7fb2f938 req-4cfa931f-fd59-46e0-8d1a-2d22af17c29f service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:17 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-6fab3356-9b45-4a0e-934f-51cf7fb2f938 req-4cfa931f-fd59-46e0-8d1a-2d22af17c29f service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:17 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-6fab3356-9b45-4a0e-934f-51cf7fb2f938 req-4cfa931f-fd59-46e0-8d1a-2d22af17c29f service nova] Creating event network-vif-plugged:2446f800-78b9-4e6d-80cb-23be097676bd for instance e3fa57cc-781a-402e-91fc-e4ee5640960b on user Apr 14 19:12:17 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-6fab3356-9b45-4a0e-934f-51cf7fb2f938 req-4cfa931f-fd59-46e0-8d1a-2d22af17c29f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030763 Apr 14 19:12:17 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 374/1121] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:12:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:12:41 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=6 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:12:41 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=10 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:12:41 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-6c7fc159-60ce-4149-b29e-f11acbcae0bc tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:12:41 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-6c7fc159-60ce-4149-b29e-f11acbcae0bc tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:12:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6c7fc159-60ce-4149-b29e-f11acbcae0bc tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6c7fc159-60ce-4149-b29e-f11acbcae0bc tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6c7fc159-60ce-4149-b29e-f11acbcae0bc tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6c7fc159-60ce-4149-b29e-f11acbcae0bc tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6c7fc159-60ce-4149-b29e-f11acbcae0bc tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:41 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-6c7fc159-60ce-4149-b29e-f11acbcae0bc tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:41 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-6c7fc159-60ce-4149-b29e-f11acbcae0bc tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.165442 Apr 14 19:12:41 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 377/1122] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 19:12:41 2023] GET /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed/os-interface => generated 283 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 19:12:42 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:12:42 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:12:42 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:12:42 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:12:42 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-4007c8b5-57fe-4cda-a5af-3fd91c4e340c tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:12:42 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-4007c8b5-57fe-4cda-a5af-3fd91c4e340c tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:12:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-4007c8b5-57fe-4cda-a5af-3fd91c4e340c tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-4007c8b5-57fe-4cda-a5af-3fd91c4e340c tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-4007c8b5-57fe-4cda-a5af-3fd91c4e340c tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-4007c8b5-57fe-4cda-a5af-3fd91c4e340c tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-4007c8b5-57fe-4cda-a5af-3fd91c4e340c tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:42 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-4007c8b5-57fe-4cda-a5af-3fd91c4e340c tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:42 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-9c8f5af5-eec5-4e8d-8d9d-cfed387b50aa req-1f39b3df-5a58-46e0-81f0-b4a8a3ec9d4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00ddbcca-fe9f-4417-8b6f-96671e666aed", "tag": "9ee81da0-d1c9-443e-b4ea-73648dd076fa"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:12:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9c8f5af5-eec5-4e8d-8d9d-cfed387b50aa req-1f39b3df-5a58-46e0-81f0-b4a8a3ec9d4e service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9c8f5af5-eec5-4e8d-8d9d-cfed387b50aa req-1f39b3df-5a58-46e0-81f0-b4a8a3ec9d4e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:42 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-9c8f5af5-eec5-4e8d-8d9d-cfed387b50aa req-1f39b3df-5a58-46e0-81f0-b4a8a3ec9d4e service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:42 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-4007c8b5-57fe-4cda-a5af-3fd91c4e340c tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed/ips" status: 200 len: 111 microversion: 2.20 time: 0.045031 Apr 14 19:12:42 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 375/1123] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 14 19:12:42 2023] GET /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed/ips => generated 111 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 19:12:42 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-9c8f5af5-eec5-4e8d-8d9d-cfed387b50aa req-1f39b3df-5a58-46e0-81f0-b4a8a3ec9d4e service nova] Creating event network-changed:9ee81da0-d1c9-443e-b4ea-73648dd076fa for instance 00ddbcca-fe9f-4417-8b6f-96671e666aed on user Apr 14 19:12:42 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-9c8f5af5-eec5-4e8d-8d9d-cfed387b50aa req-1f39b3df-5a58-46e0-81f0-b4a8a3ec9d4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103889 Apr 14 19:12:42 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 372/1124] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:12:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:12:44 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:12:44 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:12:44 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:44 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:44 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:44 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:44 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:44 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:44 user devstack@n-api.service[61674]: DEBUG nova.objects.instance [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lazy-loading 'flavor' on Instance uuid 00ddbcca-fe9f-4417-8b6f-96671e666aed {{(pid=61674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 19:12:45 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "POST /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed/action" status: 202 len: 0 microversion: 2.20 time: 0.855094 Apr 14 19:12:45 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 378/1125] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 19:12:44 2023] POST /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed/action => generated 0 bytes in 857 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 19:12:45 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-6fa0baa1-dde5-4000-b19a-6f76c7f071da tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:12:45 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-6fa0baa1-dde5-4000-b19a-6f76c7f071da tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:12:45 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-6fa0baa1-dde5-4000-b19a-6f76c7f071da tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:45 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-6fa0baa1-dde5-4000-b19a-6f76c7f071da tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:45 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-6fa0baa1-dde5-4000-b19a-6f76c7f071da tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:45 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-6fa0baa1-dde5-4000-b19a-6f76c7f071da tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:45 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-6fa0baa1-dde5-4000-b19a-6f76c7f071da tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:45 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-6fa0baa1-dde5-4000-b19a-6f76c7f071da tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:46 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-6fa0baa1-dde5-4000-b19a-6f76c7f071da tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:12:46 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-6fa0baa1-dde5-4000-b19a-6f76c7f071da tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:12:46 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-6fa0baa1-dde5-4000-b19a-6f76c7f071da tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:12:46 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-6fa0baa1-dde5-4000-b19a-6f76c7f071da tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed" status: 200 len: 1711 microversion: 2.20 time: 0.222624 Apr 14 19:12:46 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 376/1126] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:12:45 2023] GET /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed => generated 1711 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 19:12:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-a2ebbfd5-98b8-49c5-aff5-d47b61f310ab req-6378f6a1-1051-4026-ad63-82dbac89e25d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ddbcca-fe9f-4417-8b6f-96671e666aed", "name": "network-vif-unplugged", "status": "completed", "tag": "9ee81da0-d1c9-443e-b4ea-73648dd076fa"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:12:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-a2ebbfd5-98b8-49c5-aff5-d47b61f310ab req-6378f6a1-1051-4026-ad63-82dbac89e25d service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-a2ebbfd5-98b8-49c5-aff5-d47b61f310ab req-6378f6a1-1051-4026-ad63-82dbac89e25d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-a2ebbfd5-98b8-49c5-aff5-d47b61f310ab req-6378f6a1-1051-4026-ad63-82dbac89e25d service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:46 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-a2ebbfd5-98b8-49c5-aff5-d47b61f310ab req-6378f6a1-1051-4026-ad63-82dbac89e25d service nova] Creating event network-vif-unplugged:9ee81da0-d1c9-443e-b4ea-73648dd076fa for instance 00ddbcca-fe9f-4417-8b6f-96671e666aed on user Apr 14 19:12:46 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-a2ebbfd5-98b8-49c5-aff5-d47b61f310ab req-6378f6a1-1051-4026-ad63-82dbac89e25d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069088 Apr 14 19:12:46 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 373/1127] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:12:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:12:48 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-300663f2-81ce-4221-b962-a9bf8ce9976e req-ed8fd3d6-dbdd-4367-afe7-d5448f422381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ddbcca-fe9f-4417-8b6f-96671e666aed", "name": "network-vif-plugged", "status": "completed", "tag": "9ee81da0-d1c9-443e-b4ea-73648dd076fa"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:12:48 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-300663f2-81ce-4221-b962-a9bf8ce9976e req-ed8fd3d6-dbdd-4367-afe7-d5448f422381 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:48 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-300663f2-81ce-4221-b962-a9bf8ce9976e req-ed8fd3d6-dbdd-4367-afe7-d5448f422381 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:48 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-300663f2-81ce-4221-b962-a9bf8ce9976e req-ed8fd3d6-dbdd-4367-afe7-d5448f422381 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:48 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-300663f2-81ce-4221-b962-a9bf8ce9976e req-ed8fd3d6-dbdd-4367-afe7-d5448f422381 service nova] Creating event network-vif-plugged:9ee81da0-d1c9-443e-b4ea-73648dd076fa for instance 00ddbcca-fe9f-4417-8b6f-96671e666aed on user Apr 14 19:12:48 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-300663f2-81ce-4221-b962-a9bf8ce9976e req-ed8fd3d6-dbdd-4367-afe7-d5448f422381 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051980 Apr 14 19:12:48 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 379/1128] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:12:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:12:50 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:12:50 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:12:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:50 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:50 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Going to try to terminate instance {{(pid=61675) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 19:12:50 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dc3a90f6-84b2-4244-a29d-498da82b9a7f" status: 204 len: 0 microversion: 2.1 time: 0.130306 Apr 14 19:12:50 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 377/1129] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:12:50 2023] DELETE /compute/v2.1/servers/dc3a90f6-84b2-4244-a29d-498da82b9a7f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 19:12:50 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-6932f4c4-8b1e-4b1e-beb2-49fd0a5b6d22 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:12:50 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-6932f4c4-8b1e-4b1e-beb2-49fd0a5b6d22 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:12:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6932f4c4-8b1e-4b1e-beb2-49fd0a5b6d22 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6932f4c4-8b1e-4b1e-beb2-49fd0a5b6d22 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6932f4c4-8b1e-4b1e-beb2-49fd0a5b6d22 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6932f4c4-8b1e-4b1e-beb2-49fd0a5b6d22 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6932f4c4-8b1e-4b1e-beb2-49fd0a5b6d22 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:50 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-6932f4c4-8b1e-4b1e-beb2-49fd0a5b6d22 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:50 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-32ea81ff-1e4f-43ac-af6a-b1a0bcf1a7ad req-eb81dc12-5062-4dfe-9e78-26ffe3b5d0bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00ddbcca-fe9f-4417-8b6f-96671e666aed", "tag": "9ee81da0-d1c9-443e-b4ea-73648dd076fa"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:12:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-32ea81ff-1e4f-43ac-af6a-b1a0bcf1a7ad req-eb81dc12-5062-4dfe-9e78-26ffe3b5d0bb service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-32ea81ff-1e4f-43ac-af6a-b1a0bcf1a7ad req-eb81dc12-5062-4dfe-9e78-26ffe3b5d0bb service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:50 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-32ea81ff-1e4f-43ac-af6a-b1a0bcf1a7ad req-eb81dc12-5062-4dfe-9e78-26ffe3b5d0bb service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:50 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-32ea81ff-1e4f-43ac-af6a-b1a0bcf1a7ad req-eb81dc12-5062-4dfe-9e78-26ffe3b5d0bb service nova] Creating event network-changed:9ee81da0-d1c9-443e-b4ea-73648dd076fa for instance 00ddbcca-fe9f-4417-8b6f-96671e666aed on user Apr 14 19:12:50 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-32ea81ff-1e4f-43ac-af6a-b1a0bcf1a7ad req-eb81dc12-5062-4dfe-9e78-26ffe3b5d0bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036342 Apr 14 19:12:50 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 380/1130] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:12:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:12:51 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-2cfe52f6-6975-4e8c-b31e-e8535f7af28f req-19aeadea-c9cc-446f-afb4-7ef7743e1987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3a90f6-84b2-4244-a29d-498da82b9a7f", "name": "network-vif-unplugged", "status": "completed", "tag": "1cb7c282-3494-4134-a152-9b031855bc68"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:12:51 user devstack@n-api.service[61673]: DEBUG nova.policy [None req-6932f4c4-8b1e-4b1e-beb2-49fd0a5b6d22 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '267cf755a1894891aa54e8827f9ad392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0a80ffe2f74c6285fc4586e548872c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61673) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:12:51 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-2cfe52f6-6975-4e8c-b31e-e8535f7af28f req-19aeadea-c9cc-446f-afb4-7ef7743e1987 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:51 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-2cfe52f6-6975-4e8c-b31e-e8535f7af28f req-19aeadea-c9cc-446f-afb4-7ef7743e1987 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:51 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-2cfe52f6-6975-4e8c-b31e-e8535f7af28f req-19aeadea-c9cc-446f-afb4-7ef7743e1987 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:51 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-2cfe52f6-6975-4e8c-b31e-e8535f7af28f req-19aeadea-c9cc-446f-afb4-7ef7743e1987 service nova] Creating event network-vif-unplugged:1cb7c282-3494-4134-a152-9b031855bc68 for instance dc3a90f6-84b2-4244-a29d-498da82b9a7f on user Apr 14 19:12:51 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-6932f4c4-8b1e-4b1e-beb2-49fd0a5b6d22 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc3a90f6-84b2-4244-a29d-498da82b9a7f" status: 200 len: 1492 microversion: 2.1 time: 0.454697 Apr 14 19:12:51 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 374/1131] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:12:50 2023] GET /compute/v2.1/servers/dc3a90f6-84b2-4244-a29d-498da82b9a7f => generated 1492 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:12:51 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-2cfe52f6-6975-4e8c-b31e-e8535f7af28f req-19aeadea-c9cc-446f-afb4-7ef7743e1987 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139199 Apr 14 19:12:51 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 378/1132] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:12:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:12:53 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-deaa22a2-815b-41e7-818c-af3371fd2bab req-7bc3f1ec-baad-409e-af36-fc25be8a4d34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3a90f6-84b2-4244-a29d-498da82b9a7f", "name": "network-vif-plugged", "status": "completed", "tag": "1cb7c282-3494-4134-a152-9b031855bc68"}, {"server_uuid": "dc3a90f6-84b2-4244-a29d-498da82b9a7f", "name": "network-vif-deleted", "tag": "1cb7c282-3494-4134-a152-9b031855bc68"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:12:53 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-deaa22a2-815b-41e7-818c-af3371fd2bab req-7bc3f1ec-baad-409e-af36-fc25be8a4d34 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:53 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-deaa22a2-815b-41e7-818c-af3371fd2bab req-7bc3f1ec-baad-409e-af36-fc25be8a4d34 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:53 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-deaa22a2-815b-41e7-818c-af3371fd2bab req-7bc3f1ec-baad-409e-af36-fc25be8a4d34 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:53 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-deaa22a2-815b-41e7-818c-af3371fd2bab req-7bc3f1ec-baad-409e-af36-fc25be8a4d34 service nova] Creating event network-vif-plugged:1cb7c282-3494-4134-a152-9b031855bc68 for instance dc3a90f6-84b2-4244-a29d-498da82b9a7f on user Apr 14 19:12:53 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-deaa22a2-815b-41e7-818c-af3371fd2bab req-7bc3f1ec-baad-409e-af36-fc25be8a4d34 service nova] Creating event network-vif-deleted:1cb7c282-3494-4134-a152-9b031855bc68 for instance dc3a90f6-84b2-4244-a29d-498da82b9a7f on user Apr 14 19:12:53 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-deaa22a2-815b-41e7-818c-af3371fd2bab req-7bc3f1ec-baad-409e-af36-fc25be8a4d34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029171 Apr 14 19:12:53 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 381/1133] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:12:53 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:12:56 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-cf082f14-be38-4d30-9109-e9fe2c29c777 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:12:56 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-cf082f14-be38-4d30-9109-e9fe2c29c777 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:12:56 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-cf082f14-be38-4d30-9109-e9fe2c29c777 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:56 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-cf082f14-be38-4d30-9109-e9fe2c29c777 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:56 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-cf082f14-be38-4d30-9109-e9fe2c29c777 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:56 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-cf082f14-be38-4d30-9109-e9fe2c29c777 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:56 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-cf082f14-be38-4d30-9109-e9fe2c29c777 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:56 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-cf082f14-be38-4d30-9109-e9fe2c29c777 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:56 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-cf082f14-be38-4d30-9109-e9fe2c29c777 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] HTTP exception thrown: Instance 935022b4-4ba7-4b34-a758-a00081240b4c could not be found. Apr 14 19:12:56 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-cf082f14-be38-4d30-9109-e9fe2c29c777 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Request method failure captured: Apr 14 19:12:56 user devstack@n-api.service[61673]: request: GET /compute/v2.1/servers/935022b4-4ba7-4b34-a758-a00081240b4c HTTP/1.1 Apr 14 19:12:56 user devstack@n-api.service[61673]: Accept: application/json Apr 14 19:12:56 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 19:12:56 user devstack@n-api.service[61673]: Connection: close Apr 14 19:12:56 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 19:12:56 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 19:12:56 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 19:12:56 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 19:12:56 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 19:12:56 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOaGjzEHP4gR4MoApqz0vJpRX2_SvaMHlWJEk_fU7mYw99OWl-qUsSQ6rEQ6kqDrRwocqp34lWfQib95-KwgiyuwPlyVpsmwfmwLReClbkEHff7utOAgEbSdfwWoPS9VLZQQ0SJcp_M6aCZY6cryOh5BrJ2VueTzigMFoaeOsa0D5fWA Apr 14 19:12:56 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 19:12:56 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 19:12:56 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 19:12:56 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 19:12:56 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 19:12:56 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 19:12:56 user devstack@n-api.service[61673]: X-Project-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 19:12:56 user devstack@n-api.service[61673]: X-Project-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:12:56 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 19:12:56 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 19:12:56 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:12:56 user devstack@n-api.service[61673]: X-Tenant: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:12:56 user devstack@n-api.service[61673]: X-Tenant-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 19:12:56 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:12:56 user devstack@n-api.service[61673]: X-User: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 19:12:56 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 19:12:56 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 19:12:56 user devstack@n-api.service[61673]: X-User-Id: fc3bed70703a49c8bdec2f50193c7f70 Apr 14 19:12:56 user devstack@n-api.service[61673]: X-User-Name: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 19:12:56 user devstack@n-api.service[61673]: method: > Apr 14 19:12:56 user devstack@n-api.service[61673]: exception: Instance 935022b4-4ba7-4b34-a758-a00081240b4c could not be found. Apr 14 19:12:56 user devstack@n-api.service[61673]: action_args: {'id': '935022b4-4ba7-4b34-a758-a00081240b4c'} Apr 14 19:12:56 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 935022b4-4ba7-4b34-a758-a00081240b4c could not be found. Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 935022b4-4ba7-4b34-a758-a00081240b4c could not be found. Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 935022b4-4ba7-4b34-a758-a00081240b4c could not be found. Apr 14 19:12:56 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:12:56 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-cf082f14-be38-4d30-9109-e9fe2c29c777 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Returning 404 to user: Instance 935022b4-4ba7-4b34-a758-a00081240b4c could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:12:56 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-cf082f14-be38-4d30-9109-e9fe2c29c777 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/935022b4-4ba7-4b34-a758-a00081240b4c" status: 404 len: 111 microversion: 2.1 time: 0.028838 Apr 14 19:12:56 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 375/1134] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:12:56 2023] GET /compute/v2.1/servers/935022b4-4ba7-4b34-a758-a00081240b4c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:12:57 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-550110bb-b97b-4fe1-8151-4c6df18e1aab tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:12:57 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-550110bb-b97b-4fe1-8151-4c6df18e1aab tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:12:57 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-550110bb-b97b-4fe1-8151-4c6df18e1aab tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:57 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-550110bb-b97b-4fe1-8151-4c6df18e1aab tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:57 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-550110bb-b97b-4fe1-8151-4c6df18e1aab tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:57 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-550110bb-b97b-4fe1-8151-4c6df18e1aab tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:57 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-550110bb-b97b-4fe1-8151-4c6df18e1aab tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:57 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-550110bb-b97b-4fe1-8151-4c6df18e1aab tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:57 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-550110bb-b97b-4fe1-8151-4c6df18e1aab tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] HTTP exception thrown: Instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 could not be found. Apr 14 19:12:57 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-550110bb-b97b-4fe1-8151-4c6df18e1aab tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Request method failure captured: Apr 14 19:12:57 user devstack@n-api.service[61675]: request: DELETE /compute/v2.1/servers/f3fde6b1-ddc9-400e-a032-f80cd32bad39 HTTP/1.1 Apr 14 19:12:57 user devstack@n-api.service[61675]: Accept: application/json Apr 14 19:12:57 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 19:12:57 user devstack@n-api.service[61675]: Connection: close Apr 14 19:12:57 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 19:12:57 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 19:12:57 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 19:12:57 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 19:12:57 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 19:12:57 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOaGjzEHP4gR4MoApqz0vJpRX2_SvaMHlWJEk_fU7mYw99OWl-qUsSQ6rEQ6kqDrRwocqp34lWfQib95-KwgiyuwPlyVpsmwfmwLReClbkEHff7utOAgEbSdfwWoPS9VLZQQ0SJcp_M6aCZY6cryOh5BrJ2VueTzigMFoaeOsa0D5fWA Apr 14 19:12:57 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 19:12:57 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 19:12:57 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 19:12:57 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 19:12:57 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 19:12:57 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 19:12:57 user devstack@n-api.service[61675]: X-Project-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 19:12:57 user devstack@n-api.service[61675]: X-Project-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:12:57 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 19:12:57 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 19:12:57 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:12:57 user devstack@n-api.service[61675]: X-Tenant: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:12:57 user devstack@n-api.service[61675]: X-Tenant-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 19:12:57 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:12:57 user devstack@n-api.service[61675]: X-User: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 19:12:57 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 19:12:57 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 19:12:57 user devstack@n-api.service[61675]: X-User-Id: fc3bed70703a49c8bdec2f50193c7f70 Apr 14 19:12:57 user devstack@n-api.service[61675]: X-User-Name: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 19:12:57 user devstack@n-api.service[61675]: method: > Apr 14 19:12:57 user devstack@n-api.service[61675]: exception: Instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 could not be found. Apr 14 19:12:57 user devstack@n-api.service[61675]: action_args: {'id': 'f3fde6b1-ddc9-400e-a032-f80cd32bad39'} Apr 14 19:12:57 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 could not be found. Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 could not be found. Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 could not be found. Apr 14 19:12:57 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:12:57 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-550110bb-b97b-4fe1-8151-4c6df18e1aab tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Returning 404 to user: Instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:12:57 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-550110bb-b97b-4fe1-8151-4c6df18e1aab tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f3fde6b1-ddc9-400e-a032-f80cd32bad39" status: 404 len: 111 microversion: 2.1 time: 0.030512 Apr 14 19:12:57 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 379/1135] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 19:12:57 2023] DELETE /compute/v2.1/servers/f3fde6b1-ddc9-400e-a032-f80cd32bad39 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:12:57 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-4f5f0200-a52c-4302-8f17-ea374765889b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:12:57 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-4f5f0200-a52c-4302-8f17-ea374765889b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:12:57 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4f5f0200-a52c-4302-8f17-ea374765889b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:57 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4f5f0200-a52c-4302-8f17-ea374765889b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:57 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4f5f0200-a52c-4302-8f17-ea374765889b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:57 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4f5f0200-a52c-4302-8f17-ea374765889b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:12:57 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4f5f0200-a52c-4302-8f17-ea374765889b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:12:57 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4f5f0200-a52c-4302-8f17-ea374765889b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:12:57 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-4f5f0200-a52c-4302-8f17-ea374765889b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] HTTP exception thrown: Instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 could not be found. Apr 14 19:12:57 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-4f5f0200-a52c-4302-8f17-ea374765889b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Request method failure captured: Apr 14 19:12:57 user devstack@n-api.service[61674]: request: GET /compute/v2.1/servers/f3fde6b1-ddc9-400e-a032-f80cd32bad39 HTTP/1.1 Apr 14 19:12:57 user devstack@n-api.service[61674]: Accept: application/json Apr 14 19:12:57 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 19:12:57 user devstack@n-api.service[61674]: Connection: close Apr 14 19:12:57 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 19:12:57 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 19:12:57 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 19:12:57 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 19:12:57 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 19:12:57 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOaGjzEHP4gR4MoApqz0vJpRX2_SvaMHlWJEk_fU7mYw99OWl-qUsSQ6rEQ6kqDrRwocqp34lWfQib95-KwgiyuwPlyVpsmwfmwLReClbkEHff7utOAgEbSdfwWoPS9VLZQQ0SJcp_M6aCZY6cryOh5BrJ2VueTzigMFoaeOsa0D5fWA Apr 14 19:12:57 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 19:12:57 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 19:12:57 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 19:12:57 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 19:12:57 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 19:12:57 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 19:12:57 user devstack@n-api.service[61674]: X-Project-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 19:12:57 user devstack@n-api.service[61674]: X-Project-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:12:57 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 19:12:57 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 19:12:57 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/72d2bf68325a4a18934a8403571c24bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:12:57 user devstack@n-api.service[61674]: X-Tenant: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:12:57 user devstack@n-api.service[61674]: X-Tenant-Id: 72d2bf68325a4a18934a8403571c24bb Apr 14 19:12:57 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-TestVolumeBootPattern-1560263906 Apr 14 19:12:57 user devstack@n-api.service[61674]: X-User: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 19:12:57 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 19:12:57 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 19:12:57 user devstack@n-api.service[61674]: X-User-Id: fc3bed70703a49c8bdec2f50193c7f70 Apr 14 19:12:57 user devstack@n-api.service[61674]: X-User-Name: tempest-TestVolumeBootPattern-1560263906-project-member Apr 14 19:12:57 user devstack@n-api.service[61674]: method: > Apr 14 19:12:57 user devstack@n-api.service[61674]: exception: Instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 could not be found. Apr 14 19:12:57 user devstack@n-api.service[61674]: action_args: {'id': 'f3fde6b1-ddc9-400e-a032-f80cd32bad39'} Apr 14 19:12:57 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 could not be found. Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 could not be found. Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 could not be found. Apr 14 19:12:57 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:12:57 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-4f5f0200-a52c-4302-8f17-ea374765889b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Returning 404 to user: Instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:12:57 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-4f5f0200-a52c-4302-8f17-ea374765889b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3fde6b1-ddc9-400e-a032-f80cd32bad39" status: 404 len: 111 microversion: 2.1 time: 0.038259 Apr 14 19:12:57 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 382/1136] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:12:57 2023] GET /compute/v2.1/servers/f3fde6b1-ddc9-400e-a032-f80cd32bad39 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:13:00 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-aa75bbdf-c6a6-4224-83c6-4a3598b1e4fd tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Calling method '.version_select at 0x7fdae0fc3f40>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:13:00 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-aa75bbdf-c6a6-4224-83c6-4a3598b1e4fd tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-875294368" status: 202 len: 0 microversion: 2.1 time: 0.037970 Apr 14 19:13:00 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 376/1137] 10.0.0.210 () {62 vars in 1337 bytes} [Fri Apr 14 19:13:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-875294368 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 19:13:05 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-0b96a74e-d30d-40e8-9ec5-7b11068fbb9a tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:13:05 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-0b96a74e-d30d-40e8-9ec5-7b11068fbb9a tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:13:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0b96a74e-d30d-40e8-9ec5-7b11068fbb9a tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:13:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0b96a74e-d30d-40e8-9ec5-7b11068fbb9a tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:13:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0b96a74e-d30d-40e8-9ec5-7b11068fbb9a tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:13:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0b96a74e-d30d-40e8-9ec5-7b11068fbb9a tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:13:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0b96a74e-d30d-40e8-9ec5-7b11068fbb9a tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:13:05 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-0b96a74e-d30d-40e8-9ec5-7b11068fbb9a tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:13:05 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-0b96a74e-d30d-40e8-9ec5-7b11068fbb9a tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] HTTP exception thrown: Instance e3fa57cc-781a-402e-91fc-e4ee5640960b could not be found. Apr 14 19:13:05 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-0b96a74e-d30d-40e8-9ec5-7b11068fbb9a tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Request method failure captured: Apr 14 19:13:05 user devstack@n-api.service[61675]: request: GET /compute/v2.1/servers/e3fa57cc-781a-402e-91fc-e4ee5640960b HTTP/1.1 Apr 14 19:13:05 user devstack@n-api.service[61675]: Accept: application/json Apr 14 19:13:05 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 19:13:05 user devstack@n-api.service[61675]: Connection: close Apr 14 19:13:05 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 19:13:05 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 19:13:05 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 19:13:05 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 19:13:05 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 19:13:05 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOaR5UR3LuM_eLBUBIXLC25V4LTdsC0bhx8OCAoCKUk_AqLZY47anDz7BOetVTF1qu5sHLmlM-sHLhygVqxCQtwz_uULe5k1yT5puqxj4kA6s4QjJaNwYVNtgC7qzDA8qE5i2Ed-OF4uPlyRt_Wif-hHqf7MqwPWv4b5ZaFKMHZADeDo Apr 14 19:13:05 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 19:13:05 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 19:13:05 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 19:13:05 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 19:13:05 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 19:13:05 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 19:13:05 user devstack@n-api.service[61675]: X-Project-Id: 5f71b0490e5a4d3b9300dc510b936a44 Apr 14 19:13:05 user devstack@n-api.service[61675]: X-Project-Name: tempest-VolumesActionsTest-1832164482 Apr 14 19:13:05 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 19:13:05 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 19:13:05 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5f71b0490e5a4d3b9300dc510b936a44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5f71b0490e5a4d3b9300dc510b936a44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5f71b0490e5a4d3b9300dc510b936a44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:13:05 user devstack@n-api.service[61675]: X-Tenant: tempest-VolumesActionsTest-1832164482 Apr 14 19:13:05 user devstack@n-api.service[61675]: X-Tenant-Id: 5f71b0490e5a4d3b9300dc510b936a44 Apr 14 19:13:05 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-VolumesActionsTest-1832164482 Apr 14 19:13:05 user devstack@n-api.service[61675]: X-User: tempest-VolumesActionsTest-1832164482-project-member Apr 14 19:13:05 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 19:13:05 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 19:13:05 user devstack@n-api.service[61675]: X-User-Id: 0b1b6efb65b541ef992b66d9d06bd03f Apr 14 19:13:05 user devstack@n-api.service[61675]: X-User-Name: tempest-VolumesActionsTest-1832164482-project-member Apr 14 19:13:05 user devstack@n-api.service[61675]: method: > Apr 14 19:13:05 user devstack@n-api.service[61675]: exception: Instance e3fa57cc-781a-402e-91fc-e4ee5640960b could not be found. Apr 14 19:13:05 user devstack@n-api.service[61675]: action_args: {'id': 'e3fa57cc-781a-402e-91fc-e4ee5640960b'} Apr 14 19:13:05 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3fa57cc-781a-402e-91fc-e4ee5640960b could not be found. Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3fa57cc-781a-402e-91fc-e4ee5640960b could not be found. Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3fa57cc-781a-402e-91fc-e4ee5640960b could not be found. Apr 14 19:13:05 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:13:05 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-0b96a74e-d30d-40e8-9ec5-7b11068fbb9a tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Returning 404 to user: Instance e3fa57cc-781a-402e-91fc-e4ee5640960b could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:13:05 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-0b96a74e-d30d-40e8-9ec5-7b11068fbb9a tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3fa57cc-781a-402e-91fc-e4ee5640960b" status: 404 len: 111 microversion: 2.1 time: 0.153174 Apr 14 19:13:05 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 380/1138] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:13:05 2023] GET /compute/v2.1/servers/e3fa57cc-781a-402e-91fc-e4ee5640960b => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:13:36 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-7ed17b7b-408d-4ee1-b2d4-4731b6ff5840 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:13:36 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-7ed17b7b-408d-4ee1-b2d4-4731b6ff5840 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:13:36 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=12 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:13:36 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:13:36 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7ed17b7b-408d-4ee1-b2d4-4731b6ff5840 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:13:36 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7ed17b7b-408d-4ee1-b2d4-4731b6ff5840 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:13:36 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7ed17b7b-408d-4ee1-b2d4-4731b6ff5840 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:13:36 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7ed17b7b-408d-4ee1-b2d4-4731b6ff5840 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:13:36 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7ed17b7b-408d-4ee1-b2d4-4731b6ff5840 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:13:36 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-7ed17b7b-408d-4ee1-b2d4-4731b6ff5840 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:13:36 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-7ed17b7b-408d-4ee1-b2d4-4731b6ff5840 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:13:36 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-7ed17b7b-408d-4ee1-b2d4-4731b6ff5840 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:13:36 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-7ed17b7b-408d-4ee1-b2d4-4731b6ff5840 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:13:36 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-7ed17b7b-408d-4ee1-b2d4-4731b6ff5840 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed" status: 200 len: 1652 microversion: 2.20 time: 0.415387 Apr 14 19:13:36 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 383/1139] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:13:36 2023] GET /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed => generated 1652 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 19:13:41 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=12 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:13:41 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:13:41 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-c7de2bf2-32eb-4b11-a8d2-b8e7815b36a5 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:13:41 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-c7de2bf2-32eb-4b11-a8d2-b8e7815b36a5 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:13:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c7de2bf2-32eb-4b11-a8d2-b8e7815b36a5 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:13:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c7de2bf2-32eb-4b11-a8d2-b8e7815b36a5 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:13:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c7de2bf2-32eb-4b11-a8d2-b8e7815b36a5 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:13:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c7de2bf2-32eb-4b11-a8d2-b8e7815b36a5 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:13:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c7de2bf2-32eb-4b11-a8d2-b8e7815b36a5 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:13:41 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c7de2bf2-32eb-4b11-a8d2-b8e7815b36a5 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:13:41 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-c7de2bf2-32eb-4b11-a8d2-b8e7815b36a5 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] HTTP exception thrown: Instance dc3a90f6-84b2-4244-a29d-498da82b9a7f could not be found. Apr 14 19:13:41 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-c7de2bf2-32eb-4b11-a8d2-b8e7815b36a5 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Request method failure captured: Apr 14 19:13:41 user devstack@n-api.service[61673]: request: GET /compute/v2.1/servers/dc3a90f6-84b2-4244-a29d-498da82b9a7f HTTP/1.1 Apr 14 19:13:41 user devstack@n-api.service[61673]: Accept: application/json Apr 14 19:13:41 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 19:13:41 user devstack@n-api.service[61673]: Connection: close Apr 14 19:13:41 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 19:13:41 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 19:13:41 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 19:13:41 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 19:13:41 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 19:13:41 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOaU6G7_HO40HUzIeVhzsg7prSJZfoKXn9OyiYkT3RsgtQ_M2WHoZuFphb-nNWe2QsQ92SMIaJ9XQxirTC3CEwU1VeMOFukDr_c7jJ7qVCuYjhmtZXfQ_dLXVpyLED3Yd2RsugZidYspP0SR5AQDo3BW2D8u_ObPSgDUfKRAOe_2BDT0 Apr 14 19:13:41 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 19:13:41 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 19:13:41 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 19:13:41 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 19:13:41 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 19:13:41 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 19:13:41 user devstack@n-api.service[61673]: X-Project-Id: 2d0a80ffe2f74c6285fc4586e548872c Apr 14 19:13:41 user devstack@n-api.service[61673]: X-Project-Name: tempest-VolumesActionsTest-1732698399 Apr 14 19:13:41 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 19:13:41 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 19:13:41 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d0a80ffe2f74c6285fc4586e548872c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d0a80ffe2f74c6285fc4586e548872c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d0a80ffe2f74c6285fc4586e548872c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:13:41 user devstack@n-api.service[61673]: X-Tenant: tempest-VolumesActionsTest-1732698399 Apr 14 19:13:41 user devstack@n-api.service[61673]: X-Tenant-Id: 2d0a80ffe2f74c6285fc4586e548872c Apr 14 19:13:41 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-VolumesActionsTest-1732698399 Apr 14 19:13:41 user devstack@n-api.service[61673]: X-User: tempest-VolumesActionsTest-1732698399-project-member Apr 14 19:13:41 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 19:13:41 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 19:13:41 user devstack@n-api.service[61673]: X-User-Id: 267cf755a1894891aa54e8827f9ad392 Apr 14 19:13:41 user devstack@n-api.service[61673]: X-User-Name: tempest-VolumesActionsTest-1732698399-project-member Apr 14 19:13:41 user devstack@n-api.service[61673]: method: > Apr 14 19:13:41 user devstack@n-api.service[61673]: exception: Instance dc3a90f6-84b2-4244-a29d-498da82b9a7f could not be found. Apr 14 19:13:41 user devstack@n-api.service[61673]: action_args: {'id': 'dc3a90f6-84b2-4244-a29d-498da82b9a7f'} Apr 14 19:13:41 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc3a90f6-84b2-4244-a29d-498da82b9a7f could not be found. Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc3a90f6-84b2-4244-a29d-498da82b9a7f could not be found. Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc3a90f6-84b2-4244-a29d-498da82b9a7f could not be found. Apr 14 19:13:41 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:13:41 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-c7de2bf2-32eb-4b11-a8d2-b8e7815b36a5 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Returning 404 to user: Instance dc3a90f6-84b2-4244-a29d-498da82b9a7f could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:13:41 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-c7de2bf2-32eb-4b11-a8d2-b8e7815b36a5 tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc3a90f6-84b2-4244-a29d-498da82b9a7f" status: 404 len: 111 microversion: 2.1 time: 0.034354 Apr 14 19:13:41 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 377/1140] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 19:13:41 2023] GET /compute/v2.1/servers/dc3a90f6-84b2-4244-a29d-498da82b9a7f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 19:14:36 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:14:36 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:14:36 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-fc5a3aa9-9ef9-4e1c-bd45-7f24c254e1f8 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea3669a4-3685-4007-acdc-afa9d72a45f4"}} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:14:36 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-fc5a3aa9-9ef9-4e1c-bd45-7f24c254e1f8 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:14:36 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fc5a3aa9-9ef9-4e1c-bd45-7f24c254e1f8 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:14:36 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fc5a3aa9-9ef9-4e1c-bd45-7f24c254e1f8 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:14:36 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fc5a3aa9-9ef9-4e1c-bd45-7f24c254e1f8 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:14:36 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fc5a3aa9-9ef9-4e1c-bd45-7f24c254e1f8 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:14:36 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fc5a3aa9-9ef9-4e1c-bd45-7f24c254e1f8 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:14:36 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-fc5a3aa9-9ef9-4e1c-bd45-7f24c254e1f8 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:14:37 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-fc5a3aa9-9ef9-4e1c-bd45-7f24c254e1f8 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "POST /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.755095 Apr 14 19:14:37 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 381/1141] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 19:14:36 2023] POST /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed/os-volume_attachments => generated 188 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 19:14:37 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:14:37 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=6 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:14:37 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-c29332f2-ffd7-46b1-abe6-93ccc8f7f795 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:14:37 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-c29332f2-ffd7-46b1-abe6-93ccc8f7f795 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:14:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c29332f2-ffd7-46b1-abe6-93ccc8f7f795 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:14:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c29332f2-ffd7-46b1-abe6-93ccc8f7f795 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:14:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c29332f2-ffd7-46b1-abe6-93ccc8f7f795 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:14:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c29332f2-ffd7-46b1-abe6-93ccc8f7f795 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:14:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c29332f2-ffd7-46b1-abe6-93ccc8f7f795 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:14:37 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-c29332f2-ffd7-46b1-abe6-93ccc8f7f795 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:14:37 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-c29332f2-ffd7-46b1-abe6-93ccc8f7f795 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed/os-volume_attachments/ea3669a4-3685-4007-acdc-afa9d72a45f4" status: 202 len: 0 microversion: 2.20 time: 0.339679 Apr 14 19:14:37 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 384/1142] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 19:14:37 2023] DELETE /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed/os-volume_attachments/ea3669a4-3685-4007-acdc-afa9d72a45f4 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 19:14:37 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:14:37 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:14:37 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:14:37 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=2 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:14:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:14:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:14:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:14:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:14:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:14:37 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:14:38 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61673) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 19:14:38 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "POST /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed/action" status: 202 len: 0 microversion: 2.20 time: 0.345441 Apr 14 19:14:38 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 378/1143] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 19:14:37 2023] POST /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 19:14:38 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-8547690e-1fdd-4d34-a0be-21e2b5a567bd tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:14:38 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-8547690e-1fdd-4d34-a0be-21e2b5a567bd tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:14:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8547690e-1fdd-4d34-a0be-21e2b5a567bd tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:14:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8547690e-1fdd-4d34-a0be-21e2b5a567bd tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:14:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8547690e-1fdd-4d34-a0be-21e2b5a567bd tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:14:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8547690e-1fdd-4d34-a0be-21e2b5a567bd tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:14:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8547690e-1fdd-4d34-a0be-21e2b5a567bd tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:14:38 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-8547690e-1fdd-4d34-a0be-21e2b5a567bd tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:14:38 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-8547690e-1fdd-4d34-a0be-21e2b5a567bd tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:14:38 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-8547690e-1fdd-4d34-a0be-21e2b5a567bd tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:14:38 user devstack@n-api.service[61675]: DEBUG nova.policy [None req-8547690e-1fdd-4d34-a0be-21e2b5a567bd tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61675) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:14:38 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-8547690e-1fdd-4d34-a0be-21e2b5a567bd tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed" status: 200 len: 1660 microversion: 2.20 time: 0.260673 Apr 14 19:14:38 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 382/1144] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:14:38 2023] GET /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed => generated 1660 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 19:14:40 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-6ba0dcd6-d63e-4100-a9aa-ddbf1a81aa42 req-1fd18696-bf9e-40f6-ae5e-da0921f57a2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00ddbcca-fe9f-4417-8b6f-96671e666aed", "tag": "9ee81da0-d1c9-443e-b4ea-73648dd076fa"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:14:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6ba0dcd6-d63e-4100-a9aa-ddbf1a81aa42 req-1fd18696-bf9e-40f6-ae5e-da0921f57a2b service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:14:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6ba0dcd6-d63e-4100-a9aa-ddbf1a81aa42 req-1fd18696-bf9e-40f6-ae5e-da0921f57a2b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:14:40 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-6ba0dcd6-d63e-4100-a9aa-ddbf1a81aa42 req-1fd18696-bf9e-40f6-ae5e-da0921f57a2b service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:14:40 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-6ba0dcd6-d63e-4100-a9aa-ddbf1a81aa42 req-1fd18696-bf9e-40f6-ae5e-da0921f57a2b service nova] Creating event network-changed:9ee81da0-d1c9-443e-b4ea-73648dd076fa for instance 00ddbcca-fe9f-4417-8b6f-96671e666aed on user Apr 14 19:14:40 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-6ba0dcd6-d63e-4100-a9aa-ddbf1a81aa42 req-1fd18696-bf9e-40f6-ae5e-da0921f57a2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033063 Apr 14 19:14:40 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 385/1145] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:14:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:14:46 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-cd24560d-690f-4dc2-8a3f-306986554cf4 req-e13436c3-5b81-463f-b840-ace7b7d6f88a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ddbcca-fe9f-4417-8b6f-96671e666aed", "name": "network-vif-plugged", "status": "completed", "tag": "9ee81da0-d1c9-443e-b4ea-73648dd076fa"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:14:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-cd24560d-690f-4dc2-8a3f-306986554cf4 req-e13436c3-5b81-463f-b840-ace7b7d6f88a service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:14:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-cd24560d-690f-4dc2-8a3f-306986554cf4 req-e13436c3-5b81-463f-b840-ace7b7d6f88a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:14:46 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-cd24560d-690f-4dc2-8a3f-306986554cf4 req-e13436c3-5b81-463f-b840-ace7b7d6f88a service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:14:46 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-cd24560d-690f-4dc2-8a3f-306986554cf4 req-e13436c3-5b81-463f-b840-ace7b7d6f88a service nova] Creating event network-vif-plugged:9ee81da0-d1c9-443e-b4ea-73648dd076fa for instance 00ddbcca-fe9f-4417-8b6f-96671e666aed on user Apr 14 19:14:46 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-cd24560d-690f-4dc2-8a3f-306986554cf4 req-e13436c3-5b81-463f-b840-ace7b7d6f88a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038581 Apr 14 19:14:46 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 379/1146] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:14:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:14:49 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-43c7e796-b2a9-4527-b424-4f871c328225 req-5ff2a508-8d6b-46f7-beaa-ef70c564c781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ddbcca-fe9f-4417-8b6f-96671e666aed", "name": "network-vif-plugged", "status": "completed", "tag": "9ee81da0-d1c9-443e-b4ea-73648dd076fa"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:14:49 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=4 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:14:49 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:14:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-43c7e796-b2a9-4527-b424-4f871c328225 req-5ff2a508-8d6b-46f7-beaa-ef70c564c781 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:14:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-43c7e796-b2a9-4527-b424-4f871c328225 req-5ff2a508-8d6b-46f7-beaa-ef70c564c781 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:14:49 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-43c7e796-b2a9-4527-b424-4f871c328225 req-5ff2a508-8d6b-46f7-beaa-ef70c564c781 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:14:49 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-43c7e796-b2a9-4527-b424-4f871c328225 req-5ff2a508-8d6b-46f7-beaa-ef70c564c781 service nova] Creating event network-vif-plugged:9ee81da0-d1c9-443e-b4ea-73648dd076fa for instance 00ddbcca-fe9f-4417-8b6f-96671e666aed on user Apr 14 19:14:49 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-43c7e796-b2a9-4527-b424-4f871c328225 req-5ff2a508-8d6b-46f7-beaa-ef70c564c781 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040644 Apr 14 19:14:49 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 383/1147] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:14:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:15:28 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=4 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:15:28 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:15:28 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-ced8ea81-f5cc-406b-855b-ba25d5b39d33 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:15:28 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-ced8ea81-f5cc-406b-855b-ba25d5b39d33 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:15:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ced8ea81-f5cc-406b-855b-ba25d5b39d33 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:15:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ced8ea81-f5cc-406b-855b-ba25d5b39d33 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:15:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ced8ea81-f5cc-406b-855b-ba25d5b39d33 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:15:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ced8ea81-f5cc-406b-855b-ba25d5b39d33 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:15:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ced8ea81-f5cc-406b-855b-ba25d5b39d33 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:15:28 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-ced8ea81-f5cc-406b-855b-ba25d5b39d33 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:15:28 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-ced8ea81-f5cc-406b-855b-ba25d5b39d33 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:15:28 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-ced8ea81-f5cc-406b-855b-ba25d5b39d33 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:15:28 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-ced8ea81-f5cc-406b-855b-ba25d5b39d33 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:15:28 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-ced8ea81-f5cc-406b-855b-ba25d5b39d33 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed" status: 200 len: 1705 microversion: 2.20 time: 0.231858 Apr 14 19:15:28 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 386/1148] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:15:28 2023] GET /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed => generated 1705 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 19:16:28 user devstack@n-api.service[61673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 19:16:28 user devstack@n-api.service[61673]: Fri Apr 14 19:16:28 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed/os-volume_attachments (ip 10.0.0.210) !!! Apr 14 19:16:28 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:16:29 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:16:29 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-c3466a00-745f-490b-b9a9-522ddb8c6760 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:16:29 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-c3466a00-745f-490b-b9a9-522ddb8c6760 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:16:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c3466a00-745f-490b-b9a9-522ddb8c6760 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:16:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c3466a00-745f-490b-b9a9-522ddb8c6760 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:16:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c3466a00-745f-490b-b9a9-522ddb8c6760 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:16:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c3466a00-745f-490b-b9a9-522ddb8c6760 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:16:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c3466a00-745f-490b-b9a9-522ddb8c6760 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:16:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-c3466a00-745f-490b-b9a9-522ddb8c6760 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:16:29 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-c3466a00-745f-490b-b9a9-522ddb8c6760 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.064713 Apr 14 19:16:29 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 380/1149] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 19:16:28 2023] GET /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 19:16:29 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:16:29 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=2 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:16:29 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:16:29 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:16:29 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:16:29 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:16:29 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:16:29 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:16:29 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:16:29 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:16:29 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Going to try to terminate instance {{(pid=61675) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 19:16:29 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed" status: 204 len: 0 microversion: 2.20 time: 0.139747 Apr 14 19:16:29 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 384/1150] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 19:16:29 2023] DELETE /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 19:16:29 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=2 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:16:29 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=6 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:16:29 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-b6e3af68-5ad7-41f8-86f7-432f45392dec tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:16:29 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-b6e3af68-5ad7-41f8-86f7-432f45392dec tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:16:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b6e3af68-5ad7-41f8-86f7-432f45392dec tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:16:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b6e3af68-5ad7-41f8-86f7-432f45392dec tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:16:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b6e3af68-5ad7-41f8-86f7-432f45392dec tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:16:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b6e3af68-5ad7-41f8-86f7-432f45392dec tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:16:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b6e3af68-5ad7-41f8-86f7-432f45392dec tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:16:29 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-b6e3af68-5ad7-41f8-86f7-432f45392dec tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:16:29 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-b6e3af68-5ad7-41f8-86f7-432f45392dec tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:16:29 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-b6e3af68-5ad7-41f8-86f7-432f45392dec tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:16:29 user devstack@n-api.service[61674]: DEBUG nova.policy [None req-b6e3af68-5ad7-41f8-86f7-432f45392dec tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61674) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 19:16:29 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-b6e3af68-5ad7-41f8-86f7-432f45392dec tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed" status: 200 len: 1711 microversion: 2.20 time: 0.361096 Apr 14 19:16:29 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [req-4df0d866-18c4-44e0-b564-355d3fc558d8 req-338e3bd5-2a3f-4598-8f1e-7a025a9bc263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ddbcca-fe9f-4417-8b6f-96671e666aed", "name": "network-vif-unplugged", "status": "completed", "tag": "9ee81da0-d1c9-443e-b4ea-73648dd076fa"}]} {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:16:29 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 387/1151] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:16:29 2023] GET /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed => generated 1711 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 19:16:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-4df0d866-18c4-44e0-b564-355d3fc558d8 req-338e3bd5-2a3f-4598-8f1e-7a025a9bc263 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:16:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-4df0d866-18c4-44e0-b564-355d3fc558d8 req-338e3bd5-2a3f-4598-8f1e-7a025a9bc263 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:16:29 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [req-4df0d866-18c4-44e0-b564-355d3fc558d8 req-338e3bd5-2a3f-4598-8f1e-7a025a9bc263 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:16:29 user devstack@n-api.service[61673]: INFO nova.api.openstack.compute.server_external_events [req-4df0d866-18c4-44e0-b564-355d3fc558d8 req-338e3bd5-2a3f-4598-8f1e-7a025a9bc263 service nova] Creating event network-vif-unplugged:9ee81da0-d1c9-443e-b4ea-73648dd076fa for instance 00ddbcca-fe9f-4417-8b6f-96671e666aed on user Apr 14 19:16:29 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [req-4df0d866-18c4-44e0-b564-355d3fc558d8 req-338e3bd5-2a3f-4598-8f1e-7a025a9bc263 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031114 Apr 14 19:16:29 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 381/1152] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:16:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:16:30 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [req-adfa35b3-aa4a-4ae7-b9e9-ee88feccb1cc req-163bebbe-98c6-41ff-beeb-4b2ee3b49bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ddbcca-fe9f-4417-8b6f-96671e666aed", "name": "network-vif-deleted", "tag": "9ee81da0-d1c9-443e-b4ea-73648dd076fa"}]} {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:16:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-adfa35b3-aa4a-4ae7-b9e9-ee88feccb1cc req-163bebbe-98c6-41ff-beeb-4b2ee3b49bf7 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:16:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-adfa35b3-aa4a-4ae7-b9e9-ee88feccb1cc req-163bebbe-98c6-41ff-beeb-4b2ee3b49bf7 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:16:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [req-adfa35b3-aa4a-4ae7-b9e9-ee88feccb1cc req-163bebbe-98c6-41ff-beeb-4b2ee3b49bf7 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:16:30 user devstack@n-api.service[61675]: INFO nova.api.openstack.compute.server_external_events [req-adfa35b3-aa4a-4ae7-b9e9-ee88feccb1cc req-163bebbe-98c6-41ff-beeb-4b2ee3b49bf7 service nova] Creating event network-vif-deleted:9ee81da0-d1c9-443e-b4ea-73648dd076fa for instance 00ddbcca-fe9f-4417-8b6f-96671e666aed on user Apr 14 19:16:30 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [req-adfa35b3-aa4a-4ae7-b9e9-ee88feccb1cc req-163bebbe-98c6-41ff-beeb-4b2ee3b49bf7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028826 Apr 14 19:16:30 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 385/1153] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:16:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:16:31 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [req-f69fcbc2-c1b9-456f-b2dc-54477e94c1a3 req-4289a075-37bd-4404-b565-e9f646f6e431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ddbcca-fe9f-4417-8b6f-96671e666aed", "name": "network-vif-plugged", "status": "completed", "tag": "9ee81da0-d1c9-443e-b4ea-73648dd076fa"}]} {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 19:16:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-f69fcbc2-c1b9-456f-b2dc-54477e94c1a3 req-4289a075-37bd-4404-b565-e9f646f6e431 service nova] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:16:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-f69fcbc2-c1b9-456f-b2dc-54477e94c1a3 req-4289a075-37bd-4404-b565-e9f646f6e431 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:16:31 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [req-f69fcbc2-c1b9-456f-b2dc-54477e94c1a3 req-4289a075-37bd-4404-b565-e9f646f6e431 service nova] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:16:31 user devstack@n-api.service[61674]: INFO nova.api.openstack.compute.server_external_events [req-f69fcbc2-c1b9-456f-b2dc-54477e94c1a3 req-4289a075-37bd-4404-b565-e9f646f6e431 service nova] Creating event network-vif-plugged:9ee81da0-d1c9-443e-b4ea-73648dd076fa for instance 00ddbcca-fe9f-4417-8b6f-96671e666aed on user Apr 14 19:16:31 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [req-f69fcbc2-c1b9-456f-b2dc-54477e94c1a3 req-4289a075-37bd-4404-b565-e9f646f6e431 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074687 Apr 14 19:16:31 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 388/1154] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 19:16:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 19:17:19 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_api:SELECT=4 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:17:19 user devstack@n-api.service[61673]: DEBUG dbcounter [-] [61673] Writing DB stats nova_cell1:SELECT=8 {{(pid=61673) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:17:19 user devstack@n-api.service[61673]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 14 19:17:19 user devstack@n-api.service[61673]: Fri Apr 14 19:17:19 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed (ip 10.0.0.210) !!! Apr 14 19:17:19 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-2cbec064-5aab-4c7c-b9af-3380da4d763e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:17:19 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-2cbec064-5aab-4c7c-b9af-3380da4d763e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:17:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2cbec064-5aab-4c7c-b9af-3380da4d763e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:17:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2cbec064-5aab-4c7c-b9af-3380da4d763e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:17:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2cbec064-5aab-4c7c-b9af-3380da4d763e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:17:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2cbec064-5aab-4c7c-b9af-3380da4d763e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:17:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2cbec064-5aab-4c7c-b9af-3380da4d763e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:17:19 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-2cbec064-5aab-4c7c-b9af-3380da4d763e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:17:19 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-2cbec064-5aab-4c7c-b9af-3380da4d763e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] HTTP exception thrown: Instance 00ddbcca-fe9f-4417-8b6f-96671e666aed could not be found. Apr 14 19:17:19 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-2cbec064-5aab-4c7c-b9af-3380da4d763e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Request method failure captured: Apr 14 19:17:19 user devstack@n-api.service[61673]: request: GET /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed HTTP/1.1 Apr 14 19:17:19 user devstack@n-api.service[61673]: Accept: application/json Apr 14 19:17:19 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 19:17:19 user devstack@n-api.service[61673]: Connection: close Apr 14 19:17:19 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 19:17:19 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 19:17:19 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 19:17:19 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 19:17:19 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 19:17:19 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOaN8NviZZWivuIogpCJhb-hP7UruUjtByeurIoOdziN-LVB5ZG6sXWjjXi6tDv192ozBb9AxbmHYLx2yXn46BceMqwciJnywhpXZ276wjSu5U7cHLe8Dp1i9V15TcGBnRP3NY86Yd39GiCcmmH-27TsbPeWgxAg3gWGnUO33X7Raw-o Apr 14 19:17:19 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 19:17:19 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 19:17:19 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 19:17:19 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 19:17:19 user devstack@n-api.service[61673]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 19:17:19 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 19:17:19 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 19:17:19 user devstack@n-api.service[61673]: X-Project-Id: ebb0956418bd462c84e1392a74b5ae2e Apr 14 19:17:19 user devstack@n-api.service[61673]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1405261713 Apr 14 19:17:19 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 19:17:19 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 19:17:19 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ebb0956418bd462c84e1392a74b5ae2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ebb0956418bd462c84e1392a74b5ae2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ebb0956418bd462c84e1392a74b5ae2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:17:19 user devstack@n-api.service[61673]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1405261713 Apr 14 19:17:19 user devstack@n-api.service[61673]: X-Tenant-Id: ebb0956418bd462c84e1392a74b5ae2e Apr 14 19:17:19 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1405261713 Apr 14 19:17:19 user devstack@n-api.service[61673]: X-User: tempest-AttachVolumeShelveTestJSON-1405261713-project-member Apr 14 19:17:19 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 19:17:19 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 19:17:19 user devstack@n-api.service[61673]: X-User-Id: 716e5499c6eb483e9c88fd25606018d9 Apr 14 19:17:19 user devstack@n-api.service[61673]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1405261713-project-member Apr 14 19:17:19 user devstack@n-api.service[61673]: method: > Apr 14 19:17:19 user devstack@n-api.service[61673]: exception: Instance 00ddbcca-fe9f-4417-8b6f-96671e666aed could not be found. Apr 14 19:17:19 user devstack@n-api.service[61673]: action_args: {'id': '00ddbcca-fe9f-4417-8b6f-96671e666aed'} Apr 14 19:17:19 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00ddbcca-fe9f-4417-8b6f-96671e666aed could not be found. Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00ddbcca-fe9f-4417-8b6f-96671e666aed could not be found. Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00ddbcca-fe9f-4417-8b6f-96671e666aed could not be found. Apr 14 19:17:19 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:17:19 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-2cbec064-5aab-4c7c-b9af-3380da4d763e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Returning 404 to user: Instance 00ddbcca-fe9f-4417-8b6f-96671e666aed could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:17:19 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-2cbec064-5aab-4c7c-b9af-3380da4d763e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed" status: 404 len: 111 microversion: 2.20 time: 0.041139 Apr 14 19:17:19 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 382/1155] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:17:19 2023] GET /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 19:17:19 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:17:19 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:17:19 user devstack@n-api.service[61675]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 14 19:17:19 user devstack@n-api.service[61675]: Fri Apr 14 19:17:19 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1714568544 (ip 10.0.0.210) !!! Apr 14 19:17:19 user devstack@n-api.service[61675]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 14 19:17:19 user devstack@n-api.service[61675]: Fri Apr 14 19:17:19 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1714568544 (ip 10.0.0.210) !!! Apr 14 19:17:19 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-9b25bc04-1cef-4bf8-87fb-afb4574e1510 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '.version_select at 0x7fdae0e01510>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:17:19 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-9b25bc04-1cef-4bf8-87fb-afb4574e1510 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1714568544" status: 204 len: 0 microversion: 2.20 time: 0.044920 Apr 14 19:17:19 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 386/1156] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 19:17:19 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1714568544 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 19:17:27 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-f127f1b9-85b7-4156-83a6-451326c92556 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:17:27 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-f127f1b9-85b7-4156-83a6-451326c92556 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2babc665-9dbc-4cfa-9667-665e687c0e9f] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 19:17:27 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_api:SELECT=4 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:17:27 user devstack@n-api.service[61674]: DEBUG dbcounter [-] [61674] Writing DB stats nova_cell1:SELECT=8 {{(pid=61674) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:17:27 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f127f1b9-85b7-4156-83a6-451326c92556 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:17:27 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f127f1b9-85b7-4156-83a6-451326c92556 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:17:27 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f127f1b9-85b7-4156-83a6-451326c92556 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:17:27 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f127f1b9-85b7-4156-83a6-451326c92556 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:17:27 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f127f1b9-85b7-4156-83a6-451326c92556 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:17:27 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-f127f1b9-85b7-4156-83a6-451326c92556 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:17:27 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-f127f1b9-85b7-4156-83a6-451326c92556 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] HTTP exception thrown: Instance 00ddbcca-fe9f-4417-8b6f-96671e666aed could not be found. Apr 14 19:17:27 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-f127f1b9-85b7-4156-83a6-451326c92556 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Request method failure captured: Apr 14 19:17:27 user devstack@n-api.service[61674]: request: DELETE /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed HTTP/1.1 Apr 14 19:17:27 user devstack@n-api.service[61674]: Accept: application/json Apr 14 19:17:27 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 19:17:27 user devstack@n-api.service[61674]: Connection: close Apr 14 19:17:27 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 19:17:27 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 19:17:27 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 19:17:27 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 19:17:27 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 19:17:27 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOaN8NviZZWivuIogpCJhb-hP7UruUjtByeurIoOdziN-LVB5ZG6sXWjjXi6tDv192ozBb9AxbmHYLx2yXn46BceMqwciJnywhpXZ276wjSu5U7cHLe8Dp1i9V15TcGBnRP3NY86Yd39GiCcmmH-27TsbPeWgxAg3gWGnUO33X7Raw-o Apr 14 19:17:27 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 19:17:27 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 19:17:27 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 19:17:27 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 19:17:27 user devstack@n-api.service[61674]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 19:17:27 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 19:17:27 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 19:17:27 user devstack@n-api.service[61674]: X-Project-Id: ebb0956418bd462c84e1392a74b5ae2e Apr 14 19:17:27 user devstack@n-api.service[61674]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1405261713 Apr 14 19:17:27 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 19:17:27 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 19:17:27 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ebb0956418bd462c84e1392a74b5ae2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ebb0956418bd462c84e1392a74b5ae2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ebb0956418bd462c84e1392a74b5ae2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:17:27 user devstack@n-api.service[61674]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1405261713 Apr 14 19:17:27 user devstack@n-api.service[61674]: X-Tenant-Id: ebb0956418bd462c84e1392a74b5ae2e Apr 14 19:17:27 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1405261713 Apr 14 19:17:27 user devstack@n-api.service[61674]: X-User: tempest-AttachVolumeShelveTestJSON-1405261713-project-member Apr 14 19:17:27 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 19:17:27 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 19:17:27 user devstack@n-api.service[61674]: X-User-Id: 716e5499c6eb483e9c88fd25606018d9 Apr 14 19:17:27 user devstack@n-api.service[61674]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1405261713-project-member Apr 14 19:17:27 user devstack@n-api.service[61674]: method: > Apr 14 19:17:27 user devstack@n-api.service[61674]: exception: Instance 00ddbcca-fe9f-4417-8b6f-96671e666aed could not be found. Apr 14 19:17:27 user devstack@n-api.service[61674]: action_args: {'id': '00ddbcca-fe9f-4417-8b6f-96671e666aed'} Apr 14 19:17:27 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00ddbcca-fe9f-4417-8b6f-96671e666aed could not be found. Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00ddbcca-fe9f-4417-8b6f-96671e666aed could not be found. Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00ddbcca-fe9f-4417-8b6f-96671e666aed could not be found. Apr 14 19:17:27 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:17:27 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-f127f1b9-85b7-4156-83a6-451326c92556 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Returning 404 to user: Instance 00ddbcca-fe9f-4417-8b6f-96671e666aed could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:17:27 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-f127f1b9-85b7-4156-83a6-451326c92556 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed" status: 404 len: 111 microversion: 2.20 time: 0.047715 Apr 14 19:17:27 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 389/1157] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 19:17:27 2023] DELETE /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 19:17:27 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-63956a16-0cfa-42a0-85e4-834b6890c09a tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:17:27 user devstack@n-api.service[61673]: DEBUG nova.compute.api [None req-63956a16-0cfa-42a0-85e4-834b6890c09a tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Fetching instance by UUID {{(pid=61673) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:17:27 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-63956a16-0cfa-42a0-85e4-834b6890c09a tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:17:27 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-63956a16-0cfa-42a0-85e4-834b6890c09a tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:17:27 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-63956a16-0cfa-42a0-85e4-834b6890c09a tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:17:27 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-63956a16-0cfa-42a0-85e4-834b6890c09a tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:17:27 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-63956a16-0cfa-42a0-85e4-834b6890c09a tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:17:27 user devstack@n-api.service[61673]: DEBUG oslo_concurrency.lockutils [None req-63956a16-0cfa-42a0-85e4-834b6890c09a tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61673) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:17:27 user devstack@n-api.service[61673]: INFO nova.api.openstack.wsgi [None req-63956a16-0cfa-42a0-85e4-834b6890c09a tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] HTTP exception thrown: Instance 00ddbcca-fe9f-4417-8b6f-96671e666aed could not be found. Apr 14 19:17:27 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-63956a16-0cfa-42a0-85e4-834b6890c09a tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Request method failure captured: Apr 14 19:17:27 user devstack@n-api.service[61673]: request: GET /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed HTTP/1.1 Apr 14 19:17:27 user devstack@n-api.service[61673]: Accept: application/json Apr 14 19:17:27 user devstack@n-api.service[61673]: Accept-Encoding: identity Apr 14 19:17:27 user devstack@n-api.service[61673]: Connection: close Apr 14 19:17:27 user devstack@n-api.service[61673]: Content-Length: 0 Apr 14 19:17:27 user devstack@n-api.service[61673]: Content-Type: application/json Apr 14 19:17:27 user devstack@n-api.service[61673]: Host: 10.0.0.210 Apr 14 19:17:27 user devstack@n-api.service[61673]: Openstack-System-Scope: None Apr 14 19:17:27 user devstack@n-api.service[61673]: User-Agent: python-urllib3/1.26.15 Apr 14 19:17:27 user devstack@n-api.service[61673]: X-Auth-Token: gAAAAABkOaN8NviZZWivuIogpCJhb-hP7UruUjtByeurIoOdziN-LVB5ZG6sXWjjXi6tDv192ozBb9AxbmHYLx2yXn46BceMqwciJnywhpXZ276wjSu5U7cHLe8Dp1i9V15TcGBnRP3NY86Yd39GiCcmmH-27TsbPeWgxAg3gWGnUO33X7Raw-o Apr 14 19:17:27 user devstack@n-api.service[61673]: X-Domain-Id: None Apr 14 19:17:27 user devstack@n-api.service[61673]: X-Domain-Name: None Apr 14 19:17:27 user devstack@n-api.service[61673]: X-Identity-Status: Confirmed Apr 14 19:17:27 user devstack@n-api.service[61673]: X-Is-Admin-Project: True Apr 14 19:17:27 user devstack@n-api.service[61673]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 19:17:27 user devstack@n-api.service[61673]: X-Project-Domain-Id: default Apr 14 19:17:27 user devstack@n-api.service[61673]: X-Project-Domain-Name: Default Apr 14 19:17:27 user devstack@n-api.service[61673]: X-Project-Id: ebb0956418bd462c84e1392a74b5ae2e Apr 14 19:17:27 user devstack@n-api.service[61673]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1405261713 Apr 14 19:17:27 user devstack@n-api.service[61673]: X-Role: reader,member Apr 14 19:17:27 user devstack@n-api.service[61673]: X-Roles: reader,member Apr 14 19:17:27 user devstack@n-api.service[61673]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ebb0956418bd462c84e1392a74b5ae2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ebb0956418bd462c84e1392a74b5ae2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ebb0956418bd462c84e1392a74b5ae2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:17:27 user devstack@n-api.service[61673]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1405261713 Apr 14 19:17:27 user devstack@n-api.service[61673]: X-Tenant-Id: ebb0956418bd462c84e1392a74b5ae2e Apr 14 19:17:27 user devstack@n-api.service[61673]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1405261713 Apr 14 19:17:27 user devstack@n-api.service[61673]: X-User: tempest-AttachVolumeShelveTestJSON-1405261713-project-member Apr 14 19:17:27 user devstack@n-api.service[61673]: X-User-Domain-Id: default Apr 14 19:17:27 user devstack@n-api.service[61673]: X-User-Domain-Name: Default Apr 14 19:17:27 user devstack@n-api.service[61673]: X-User-Id: 716e5499c6eb483e9c88fd25606018d9 Apr 14 19:17:27 user devstack@n-api.service[61673]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1405261713-project-member Apr 14 19:17:27 user devstack@n-api.service[61673]: method: > Apr 14 19:17:27 user devstack@n-api.service[61673]: exception: Instance 00ddbcca-fe9f-4417-8b6f-96671e666aed could not be found. Apr 14 19:17:27 user devstack@n-api.service[61673]: action_args: {'id': '00ddbcca-fe9f-4417-8b6f-96671e666aed'} Apr 14 19:17:27 user devstack@n-api.service[61673]: {{(pid=61673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00ddbcca-fe9f-4417-8b6f-96671e666aed could not be found. Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00ddbcca-fe9f-4417-8b6f-96671e666aed could not be found. Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00ddbcca-fe9f-4417-8b6f-96671e666aed could not be found. Apr 14 19:17:27 user devstack@n-api.service[61673]: ERROR nova.api.openstack.wsgi Apr 14 19:17:27 user devstack@n-api.service[61673]: DEBUG nova.api.openstack.wsgi [None req-63956a16-0cfa-42a0-85e4-834b6890c09a tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Returning 404 to user: Instance 00ddbcca-fe9f-4417-8b6f-96671e666aed could not be found. {{(pid=61673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:17:27 user devstack@n-api.service[61673]: INFO nova.api.openstack.requestlog [None req-63956a16-0cfa-42a0-85e4-834b6890c09a tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed" status: 404 len: 111 microversion: 2.20 time: 0.040826 Apr 14 19:17:27 user devstack@n-api.service[61673]: [pid: 61673|app: 0|req: 383/1158] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:17:27 2023] GET /compute/v2.1/servers/00ddbcca-fe9f-4417-8b6f-96671e666aed => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 19:17:30 user devstack@n-api.service[61675]: DEBUG dbcounter [-] [61675] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61675) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 19:17:30 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-b34b2ddd-4ff5-4a66-a113-e5cec8a367b4 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:17:30 user devstack@n-api.service[61675]: DEBUG nova.compute.api [None req-b34b2ddd-4ff5-4a66-a113-e5cec8a367b4 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Fetching instance by UUID {{(pid=61675) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:17:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b34b2ddd-4ff5-4a66-a113-e5cec8a367b4 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:17:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b34b2ddd-4ff5-4a66-a113-e5cec8a367b4 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:17:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b34b2ddd-4ff5-4a66-a113-e5cec8a367b4 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:17:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b34b2ddd-4ff5-4a66-a113-e5cec8a367b4 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:17:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b34b2ddd-4ff5-4a66-a113-e5cec8a367b4 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:17:30 user devstack@n-api.service[61675]: DEBUG oslo_concurrency.lockutils [None req-b34b2ddd-4ff5-4a66-a113-e5cec8a367b4 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61675) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:17:30 user devstack@n-api.service[61675]: INFO nova.api.openstack.wsgi [None req-b34b2ddd-4ff5-4a66-a113-e5cec8a367b4 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] HTTP exception thrown: Instance 179270ef-7866-4ee7-af13-ec3ea5e7525a could not be found. Apr 14 19:17:30 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-b34b2ddd-4ff5-4a66-a113-e5cec8a367b4 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Request method failure captured: Apr 14 19:17:30 user devstack@n-api.service[61675]: request: DELETE /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a HTTP/1.1 Apr 14 19:17:30 user devstack@n-api.service[61675]: Accept: application/json Apr 14 19:17:30 user devstack@n-api.service[61675]: Accept-Encoding: identity Apr 14 19:17:30 user devstack@n-api.service[61675]: Connection: close Apr 14 19:17:30 user devstack@n-api.service[61675]: Content-Length: 0 Apr 14 19:17:30 user devstack@n-api.service[61675]: Content-Type: application/json Apr 14 19:17:30 user devstack@n-api.service[61675]: Host: 10.0.0.210 Apr 14 19:17:30 user devstack@n-api.service[61675]: Openstack-System-Scope: None Apr 14 19:17:30 user devstack@n-api.service[61675]: User-Agent: python-urllib3/1.26.15 Apr 14 19:17:30 user devstack@n-api.service[61675]: X-Auth-Token: gAAAAABkOaN8NviZZWivuIogpCJhb-hP7UruUjtByeurIoOdziN-LVB5ZG6sXWjjXi6tDv192ozBb9AxbmHYLx2yXn46BceMqwciJnywhpXZ276wjSu5U7cHLe8Dp1i9V15TcGBnRP3NY86Yd39GiCcmmH-27TsbPeWgxAg3gWGnUO33X7Raw-o Apr 14 19:17:30 user devstack@n-api.service[61675]: X-Domain-Id: None Apr 14 19:17:30 user devstack@n-api.service[61675]: X-Domain-Name: None Apr 14 19:17:30 user devstack@n-api.service[61675]: X-Identity-Status: Confirmed Apr 14 19:17:30 user devstack@n-api.service[61675]: X-Is-Admin-Project: True Apr 14 19:17:30 user devstack@n-api.service[61675]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 19:17:30 user devstack@n-api.service[61675]: X-Project-Domain-Id: default Apr 14 19:17:30 user devstack@n-api.service[61675]: X-Project-Domain-Name: Default Apr 14 19:17:30 user devstack@n-api.service[61675]: X-Project-Id: ebb0956418bd462c84e1392a74b5ae2e Apr 14 19:17:30 user devstack@n-api.service[61675]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1405261713 Apr 14 19:17:30 user devstack@n-api.service[61675]: X-Role: reader,member Apr 14 19:17:30 user devstack@n-api.service[61675]: X-Roles: reader,member Apr 14 19:17:30 user devstack@n-api.service[61675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ebb0956418bd462c84e1392a74b5ae2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ebb0956418bd462c84e1392a74b5ae2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ebb0956418bd462c84e1392a74b5ae2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:17:30 user devstack@n-api.service[61675]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1405261713 Apr 14 19:17:30 user devstack@n-api.service[61675]: X-Tenant-Id: ebb0956418bd462c84e1392a74b5ae2e Apr 14 19:17:30 user devstack@n-api.service[61675]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1405261713 Apr 14 19:17:30 user devstack@n-api.service[61675]: X-User: tempest-AttachVolumeShelveTestJSON-1405261713-project-member Apr 14 19:17:30 user devstack@n-api.service[61675]: X-User-Domain-Id: default Apr 14 19:17:30 user devstack@n-api.service[61675]: X-User-Domain-Name: Default Apr 14 19:17:30 user devstack@n-api.service[61675]: X-User-Id: 716e5499c6eb483e9c88fd25606018d9 Apr 14 19:17:30 user devstack@n-api.service[61675]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1405261713-project-member Apr 14 19:17:30 user devstack@n-api.service[61675]: method: > Apr 14 19:17:30 user devstack@n-api.service[61675]: exception: Instance 179270ef-7866-4ee7-af13-ec3ea5e7525a could not be found. Apr 14 19:17:30 user devstack@n-api.service[61675]: action_args: {'id': '179270ef-7866-4ee7-af13-ec3ea5e7525a'} Apr 14 19:17:30 user devstack@n-api.service[61675]: {{(pid=61675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 179270ef-7866-4ee7-af13-ec3ea5e7525a could not be found. Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 179270ef-7866-4ee7-af13-ec3ea5e7525a could not be found. Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 179270ef-7866-4ee7-af13-ec3ea5e7525a could not be found. Apr 14 19:17:30 user devstack@n-api.service[61675]: ERROR nova.api.openstack.wsgi Apr 14 19:17:30 user devstack@n-api.service[61675]: DEBUG nova.api.openstack.wsgi [None req-b34b2ddd-4ff5-4a66-a113-e5cec8a367b4 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Returning 404 to user: Instance 179270ef-7866-4ee7-af13-ec3ea5e7525a could not be found. {{(pid=61675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:17:30 user devstack@n-api.service[61675]: INFO nova.api.openstack.requestlog [None req-b34b2ddd-4ff5-4a66-a113-e5cec8a367b4 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a" status: 404 len: 111 microversion: 2.20 time: 0.034563 Apr 14 19:17:30 user devstack@n-api.service[61675]: [pid: 61675|app: 0|req: 387/1159] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 19:17:30 2023] DELETE /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 19:17:30 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-4644651a-24bf-42f0-aaf1-5e130694df2c tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Calling method '>' {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 19:17:30 user devstack@n-api.service[61674]: DEBUG nova.compute.api [None req-4644651a-24bf-42f0-aaf1-5e130694df2c tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Fetching instance by UUID {{(pid=61674) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 19:17:30 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4644651a-24bf-42f0-aaf1-5e130694df2c tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:17:30 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4644651a-24bf-42f0-aaf1-5e130694df2c tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:17:30 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4644651a-24bf-42f0-aaf1-5e130694df2c tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:17:30 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4644651a-24bf-42f0-aaf1-5e130694df2c tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 19:17:30 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4644651a-24bf-42f0-aaf1-5e130694df2c tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 19:17:30 user devstack@n-api.service[61674]: DEBUG oslo_concurrency.lockutils [None req-4644651a-24bf-42f0-aaf1-5e130694df2c tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "3a2763e6-30f8-4a2f-87af-13cbbc7c1aa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61674) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 19:17:30 user devstack@n-api.service[61674]: INFO nova.api.openstack.wsgi [None req-4644651a-24bf-42f0-aaf1-5e130694df2c tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] HTTP exception thrown: Instance 179270ef-7866-4ee7-af13-ec3ea5e7525a could not be found. Apr 14 19:17:30 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-4644651a-24bf-42f0-aaf1-5e130694df2c tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Request method failure captured: Apr 14 19:17:30 user devstack@n-api.service[61674]: request: GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a HTTP/1.1 Apr 14 19:17:30 user devstack@n-api.service[61674]: Accept: application/json Apr 14 19:17:30 user devstack@n-api.service[61674]: Accept-Encoding: identity Apr 14 19:17:30 user devstack@n-api.service[61674]: Connection: close Apr 14 19:17:30 user devstack@n-api.service[61674]: Content-Length: 0 Apr 14 19:17:30 user devstack@n-api.service[61674]: Content-Type: application/json Apr 14 19:17:30 user devstack@n-api.service[61674]: Host: 10.0.0.210 Apr 14 19:17:30 user devstack@n-api.service[61674]: Openstack-System-Scope: None Apr 14 19:17:30 user devstack@n-api.service[61674]: User-Agent: python-urllib3/1.26.15 Apr 14 19:17:30 user devstack@n-api.service[61674]: X-Auth-Token: gAAAAABkOaN8NviZZWivuIogpCJhb-hP7UruUjtByeurIoOdziN-LVB5ZG6sXWjjXi6tDv192ozBb9AxbmHYLx2yXn46BceMqwciJnywhpXZ276wjSu5U7cHLe8Dp1i9V15TcGBnRP3NY86Yd39GiCcmmH-27TsbPeWgxAg3gWGnUO33X7Raw-o Apr 14 19:17:30 user devstack@n-api.service[61674]: X-Domain-Id: None Apr 14 19:17:30 user devstack@n-api.service[61674]: X-Domain-Name: None Apr 14 19:17:30 user devstack@n-api.service[61674]: X-Identity-Status: Confirmed Apr 14 19:17:30 user devstack@n-api.service[61674]: X-Is-Admin-Project: True Apr 14 19:17:30 user devstack@n-api.service[61674]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 19:17:30 user devstack@n-api.service[61674]: X-Project-Domain-Id: default Apr 14 19:17:30 user devstack@n-api.service[61674]: X-Project-Domain-Name: Default Apr 14 19:17:30 user devstack@n-api.service[61674]: X-Project-Id: ebb0956418bd462c84e1392a74b5ae2e Apr 14 19:17:30 user devstack@n-api.service[61674]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1405261713 Apr 14 19:17:30 user devstack@n-api.service[61674]: X-Role: reader,member Apr 14 19:17:30 user devstack@n-api.service[61674]: X-Roles: reader,member Apr 14 19:17:30 user devstack@n-api.service[61674]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ebb0956418bd462c84e1392a74b5ae2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ebb0956418bd462c84e1392a74b5ae2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ebb0956418bd462c84e1392a74b5ae2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 19:17:30 user devstack@n-api.service[61674]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1405261713 Apr 14 19:17:30 user devstack@n-api.service[61674]: X-Tenant-Id: ebb0956418bd462c84e1392a74b5ae2e Apr 14 19:17:30 user devstack@n-api.service[61674]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1405261713 Apr 14 19:17:30 user devstack@n-api.service[61674]: X-User: tempest-AttachVolumeShelveTestJSON-1405261713-project-member Apr 14 19:17:30 user devstack@n-api.service[61674]: X-User-Domain-Id: default Apr 14 19:17:30 user devstack@n-api.service[61674]: X-User-Domain-Name: Default Apr 14 19:17:30 user devstack@n-api.service[61674]: X-User-Id: 716e5499c6eb483e9c88fd25606018d9 Apr 14 19:17:30 user devstack@n-api.service[61674]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1405261713-project-member Apr 14 19:17:30 user devstack@n-api.service[61674]: method: > Apr 14 19:17:30 user devstack@n-api.service[61674]: exception: Instance 179270ef-7866-4ee7-af13-ec3ea5e7525a could not be found. Apr 14 19:17:30 user devstack@n-api.service[61674]: action_args: {'id': '179270ef-7866-4ee7-af13-ec3ea5e7525a'} Apr 14 19:17:30 user devstack@n-api.service[61674]: {{(pid=61674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 179270ef-7866-4ee7-af13-ec3ea5e7525a could not be found. Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 179270ef-7866-4ee7-af13-ec3ea5e7525a could not be found. Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 179270ef-7866-4ee7-af13-ec3ea5e7525a could not be found. Apr 14 19:17:30 user devstack@n-api.service[61674]: ERROR nova.api.openstack.wsgi Apr 14 19:17:30 user devstack@n-api.service[61674]: DEBUG nova.api.openstack.wsgi [None req-4644651a-24bf-42f0-aaf1-5e130694df2c tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Returning 404 to user: Instance 179270ef-7866-4ee7-af13-ec3ea5e7525a could not be found. {{(pid=61674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 19:17:30 user devstack@n-api.service[61674]: INFO nova.api.openstack.requestlog [None req-4644651a-24bf-42f0-aaf1-5e130694df2c tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 10.0.0.210 "GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a" status: 404 len: 111 microversion: 2.20 time: 0.031558 Apr 14 19:17:30 user devstack@n-api.service[61674]: [pid: 61674|app: 0|req: 390/1160] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 19:17:30 2023] GET /compute/v2.1/servers/179270ef-7866-4ee7-af13-ec3ea5e7525a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0)